-- Logs begin at Sat 2022-08-20 20:01:16 UTC, end at Sat 2022-08-20 21:01:22 UTC. -- Aug 20 20:34:26.505432 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 20 20:34:26.515086 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 20 20:34:26 2022] *** Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: nodename: dv-osbrick-master-4-ceph Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: machine: x86_64 Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: clock source: unix Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: pcre jit disabled Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: detected number of CPU cores: 4 Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: current working directory: / Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: detected binary path: /usr/bin/uwsgi-core Aug 20 20:34:26.517122 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: your processes number limit is 47680 Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: your memory page size is 4096 bytes Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: detected max file descriptor number: 2048 Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: lock engine: pthread robust mutexes Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: thunder lock: enabled Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 20 20:34:26.517721 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 20 20:34:26.563458 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: Python main interpreter initialized at 0x564f2b0789c0 Aug 20 20:34:26.563458 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: python threads support enabled Aug 20 20:34:26.563458 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: your server socket listen backlog is limited to 100 connections Aug 20 20:34:26.563458 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: your mercy for graceful operations on workers is 90 seconds Aug 20 20:34:26.563833 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: mapped 403077 bytes (393 KB) for 2 cores Aug 20 20:34:26.563833 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: *** Operational MODE: preforking *** Aug 20 20:34:26.564126 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: *** uWSGI is running in multiple interpreter mode *** Aug 20 20:34:26.564126 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: spawned uWSGI master process (pid: 94912) Aug 20 20:34:26.564286 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 20 20:34:26.565417 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: spawned uWSGI worker 1 (pid: 94924, cores: 1) Aug 20 20:34:26.565417 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: spawned uWSGI worker 2 (pid: 94925, cores: 1) Aug 20 20:34:26.565417 dv-osbrick-master-4-ceph devstack@keystone.service[94912]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 20 20:34:31.089218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 20 20:34:31.089218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: from cryptography.utils import int_from_bytes Aug 20 20:34:31.090077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 20 20:34:31.090077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: from cryptography.utils import int_from_bytes Aug 20 20:34:31.090487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 20 20:34:31.090487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: from cryptography.utils import int_from_bytes Aug 20 20:34:31.090596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 20 20:34:31.090596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: from cryptography.utils import int_from_bytes Aug 20 20:34:31.138045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 20 20:34:31.138235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 20 20:34:31.138366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] command line args: [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 20 20:34:31.138660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 20 20:34:31.138791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 20 20:34:31.138875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ================================================================================ {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 20 20:34:31.138949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 20 20:34:31.139077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] admin_token = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] command line args: [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 20 20:34:31.139309 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] config_dir = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 20 20:34:31.139470 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ================================================================================ {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 20 20:34:31.139620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] config_source = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] admin_token = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] debug = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.139956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] config_dir = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140085 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] config_source = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] debug = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140634 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140868 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.140942 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141010 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141381 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_config_append = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141508 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141706 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_dir = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_file = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.141891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_config_append = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_dir = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_file = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142645 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142778 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.142919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143022 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143379 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.143937 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144422 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.144890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145000 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145109 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145217 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145820 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.145945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] publish_errors = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146407 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] publish_errors = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146865 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.146981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] standard_threads = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147456 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] standard_threads = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.147920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148150 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] use_journal = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148150 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] use_json = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] use_stderr = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] use_syslog = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] use_journal = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.148986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.149103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] use_json = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.149103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] use_stderr = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.149387 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.149509 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] use_syslog = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.149638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.149763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:34:31.149879 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.149997 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150115 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150524 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.150917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151066 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151761 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151880 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.151998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152690 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.152922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153150 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.153921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154147 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.154938 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155507 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.155962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156149 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156494 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.156949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157872 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.157981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158549 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.158999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159748 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.159976 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160436 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160546 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160656 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160885 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.160997 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.161942 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162052 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162175 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.162914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163027 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163471 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.163934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164403 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164880 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.164992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165328 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.165912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166025 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166738 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.166962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167417 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.167991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.168896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169119 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169462 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169584 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.169938 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170288 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170632 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.170938 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171635 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171868 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.171994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172357 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172470 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172582 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.172924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173160 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173272 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173390 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173581 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.external = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.173900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174193 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.external = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174534 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174804 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.password = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.174928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] auth.token = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175379 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.password = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] auth.token = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.175951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176063 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176527 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176752 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.176989 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177103 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177216 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177328 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177441 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177553 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177809 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.177922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178389 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.178952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179187 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179401 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179634 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179747 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.179972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.180894 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181129 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181353 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.181945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182171 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.182907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183600 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.183946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184581 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184809 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.184921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185387 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.185904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186488 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.186948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187863 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.187975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188097 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188435 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.188913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189026 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189381 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.189966 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190231 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190573 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.190930 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191269 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191381 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191729 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.191955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192068 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192189 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192302 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192875 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.192988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193101 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193437 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193810 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.193922 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194034 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194146 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194498 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194723 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194835 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.194956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195070 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.195978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.196939 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197306 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.197864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198193 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198306 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198652 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.198911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199495 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199607 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.199945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200294 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200520 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.200979 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201552 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.201922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202157 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.202957 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203070 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203297 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203757 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.203988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204109 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204802 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.204917 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205029 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.205910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206022 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] role.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] role.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.206767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] role.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] role.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207486 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207599 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.207947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208060 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208637 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.208862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.209973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.210995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211443 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.211892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212003 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212122 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212689 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212809 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.212922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213368 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213488 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213652 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213878 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.213990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214101 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214562 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.214914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215027 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215362 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215593 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.215930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216613 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.216956 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217688 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.217916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218601 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218712 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.218935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219055 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.connection = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219634 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219746 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.connection = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.219990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220562 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.220907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221130 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.221941 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222054 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222179 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222744 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222865 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.222979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223093 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 20 20:34:31.223553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:34:31.223553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 20 20:34:31.248842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.249066 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.249283 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.249440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.249695 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.249920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.257648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.258127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.285867 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.286092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.286834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.287105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.339363 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.340256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.387053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.387258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.387538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.387768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452160 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.452856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.453014 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.453141 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.453269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.453352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.453417 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476340 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.476988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.477914 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.488695 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.488821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.501758 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.501898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.501977 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.502982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.503044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.503161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 20 20:34:31.519594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.519800 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 20 20:34:31.520028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.520155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.520291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 20 20:34:31.520372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 20 20:34:31.520552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.520691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.520827 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 20 20:34:31.520908 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.520972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.521045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.521257 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.521397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.521532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.521776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.530617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.530893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.531901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.538132 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.538785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.541129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.541405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.541663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.541806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.541951 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542270 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542817 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.542943 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543404 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543623 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.543888 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.544024 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.544177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.544451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.566699 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.567541 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.568140 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.568422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.568985 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.569271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.573061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.573342 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.573644 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.573765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.574077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.574357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.579927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.580211 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.580719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.581003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.585440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.585752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.586295 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586375 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586584 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.586937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587689 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.587954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.602878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.603110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.603326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.603605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.606963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.607626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.610041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.610331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.610821 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.611114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.614638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.615350 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.617762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.618577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.620846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.621141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.621421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.621654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.621798 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.621973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.622098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.622257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.622380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.622625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.622900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.623193 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.637997 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.638272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.638558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.638825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.638963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.639164 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.639432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.639693 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.645426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.646452 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.646967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.647242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.647977 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.648233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.650004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.650316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.650571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.650883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.651008 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.651211 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.651336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.651500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.651883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.652234 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.662358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.662635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.662914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663191 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.663442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.663996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.664162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.664439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.664707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.664980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.679241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.680204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.682137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.683242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.684977 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.686115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.686548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.687542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.688050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.688331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.688617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.689133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.689409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.689714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.695307 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.696045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.696429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.697504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.699331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.699617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.699909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.700187 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.700533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.700818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.701107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.701372 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.708856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.709087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.709545 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.709754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.709878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.710047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.716485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.716762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.716885 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 20 20:34:31.717045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717541 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717866 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.717992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.718925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719023 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719173 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719308 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719624 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.719891 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.720055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.720194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.720331 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 20 20:34:31.752589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f2b0789c0 pid: 94925 (default app) Aug 20 20:34:31.755907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74e4c-197c-48e2-a72a-96967f04a76c None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:31.756189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74e4c-197c-48e2-a72a-96967f04a76c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:31.756453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74e4c-197c-48e2-a72a-96967f04a76c None None] PATH_INFO: `/v3` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:31.757770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f2b0789c0 pid: 94924 (default app) Aug 20 20:34:31.760807 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sat Aug 20 20:34:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:38.866096 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:38.866700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:38.866700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:38.870989 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:38.877843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:38.878589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:38.878737 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:38.958036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: INFO dbcounter [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] Registered counter for database keystone Aug 20 20:34:38.980005 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG oslo_db.sqlalchemy.engines [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:34:38.991024 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writer thread running {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 20 20:34:39.178128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG passlib.handlers.bcrypt [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94925) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 20 20:34:39.178453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG passlib.handlers.bcrypt [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94925) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 20 20:34:39.233550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:39.235290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:39.370226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 20 20:34:39.948446 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:40.024996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: INFO dbcounter [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] Registered counter for database keystone Aug 20 20:34:40.049895 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG oslo_db.sqlalchemy.engines [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:34:40.057976 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writer thread running {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 20 20:34:40.175226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07545c-0c34-445b-a79a-b990d2abe075 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:40.180662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:40.181284 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:40.181561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:40.181842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:40.190436 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:40.241926 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 20 20:34:40.242196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17da925-3361-4c2e-b69e-e95503d46b9f admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:40.252189 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Aug 20 20:34:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 20 20:34:40.262286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:40.284183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712ade4-0ec9-4c69-bf8b-61bec7ac6724 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:40.290054 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:40.291184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:40.291518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:40.291750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] PATH_INFO: `/v3/projects/caafa8b40709435db0e905664e3dcd9f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:40.293383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] RBAC: Authorizing `identity:get_project(project_id=caafa8b40709435db0e905664e3dcd9f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:40.344216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING keystone.common.rbac_enforcer.enforcer [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 20 20:34:40.344562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263453-f893-41a9-9cb8-fbc1c63e4613 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:40.349372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Aug 20 20:34:40 2022] GET /identity/v3/projects/caafa8b40709435db0e905664e3dcd9f => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:42.485377 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2e608-a166-4413-be2c-f4a65b2679e8 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:42.486289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2e608-a166-4413-be2c-f4a65b2679e8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:42.486289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2e608-a166-4413-be2c-f4a65b2679e8 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:42.493063 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:42.500482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:42.500901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:42.501087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:42.530857 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:42.532378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:42.544021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 20 20:34:42.866468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2e608-a166-4413-be2c-f4a65b2679e8 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:42.883151 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2e608-a166-4413-be2c-f4a65b2679e8 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:42.888490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:42.889092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:42.889367 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:42.889658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:42.897604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:42.899426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81277370-282c-4357-9c56-0ef443c08809 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:42.908203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Aug 20 20:34:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 20 20:34:42.913818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:42.924087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97486e19-ff20-4bf0-a45d-b59ac0c65173 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:42.930258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:42.930898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:42.931178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:42.931453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:42.933051 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:42.935032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c96478-891e-4510-90a1-64c82e8881f6 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:42.936561 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sat Aug 20 20:34:42 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:45.144662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c9ca-4151-4787-a05c-bcf3754d840b None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.145214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c9ca-4151-4787-a05c-bcf3754d840b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.145214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c9ca-4151-4787-a05c-bcf3754d840b None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.146621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:45.152644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.153075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e5b2-11e9-45ba-a1e2-3187d1ad4b73 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.153163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.153248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e5b2-11e9-45ba-a1e2-3187d1ad4b73 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.153339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.153418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e5b2-11e9-45ba-a1e2-3187d1ad4b73 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.155215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:45.163302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.163432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.163766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.176244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:45.177429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:45.206806 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG passlib.handlers.bcrypt [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94924) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 20 20:34:45.207218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG passlib.handlers.bcrypt [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94924) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 20 20:34:45.253001 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:45.254703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:45.373563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:45.380795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:45.689982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:45.699859 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:45.715077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:45.795153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0b22f-5b79-4a9e-9714-a30ffff0a27b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:45.802089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:45.805473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828e7af-602c-4ae5-9d59-6b3ff7b6431b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:45.830012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:45.830668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.830945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.831222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.841778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:45.842652 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.842786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:34:45.842936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.843212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:34:45.851586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:34:45.852594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:34:45.853962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:34:45.858688 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:45.912906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:45.914498 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:45.940209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:45.959147 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2f7c-e198-4124-9d73-5fc38ae58b6d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:45.993010 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:45.993772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:45.994058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:45.994338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:45.995109 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:45.995418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:45.996839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.008757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:46.010857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:46.014758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:46.017907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:34:46.019953 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:46.110610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67092bb-0776-4da4-9899-18e22e1c56f1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:46.115092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03a70e-4a0e-4635-b605-3c69585fd647 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:46.145162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:46.145813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:46.146094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:46.146365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:46.147490 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:46.148556 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:46.149007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.149418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:46.149729 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:46.150003 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:46.150571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:34:46 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:46.155986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:46.168726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:46.170124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:46.170263 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:34:46.189639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:34:46.190553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:34:46.191361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:34:46.191361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:34:46.191361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:34:46.191361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:34:46.196502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:46.259895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce453cc1-1abc-4509-8b09-84f63a13af61 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:46.298725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:46.299380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:46.299645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:46.299940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:46.301126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:46.302634 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.304201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:46.310423 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:46.361850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:46.393461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:46.408104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f2ea-85ae-44c4-864b-c6e772364831 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:46.412709 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f523-47cc-41ca-a6fb-70a710ffe7bf None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:46.441553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:46.442146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:46.442424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:46.442699 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:46.443339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:46.443641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:46.445050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67e59-8ace-4139-8250-213c924ca299 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.445586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:46.446236 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:46.446511 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:46.446834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:46.447588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.domain.id=default, user.id=8b4c21c326a741f8bc5b0a71851754ff) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:46.447949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:46.449408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b1da-1fc1-4fb1-aa54-f3ff02da0bc1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:46.458116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Sat Aug 20 20:34:46 2022] GET /identity/v3/role_assignments?user.id=8b4c21c326a741f8bc5b0a71851754ff&scope.domain.id=default&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:46.463395 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:49.228198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee921-1d7e-4327-b308-6522bbeebb0a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.229245 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee921-1d7e-4327-b308-6522bbeebb0a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.229870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee921-1d7e-4327-b308-6522bbeebb0a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.231716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:49.236987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418f075-e562-434c-8736-8e85d178ef2d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.237882 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418f075-e562-434c-8736-8e85d178ef2d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.238395 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418f075-e562-434c-8736-8e85d178ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.263090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-0418f075-e562-434c-8736-8e85d178ef2d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:49.264667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-0418f075-e562-434c-8736-8e85d178ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:49.305964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6e90-e4d3-482e-83b5-7bd7b9a4706a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.306841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6e90-e4d3-482e-83b5-7bd7b9a4706a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.307365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6e90-e4d3-482e-83b5-7bd7b9a4706a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.309474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:49.310945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b653a-154d-4912-8fdd-dc1eea926be5 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.311418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b653a-154d-4912-8fdd-dc1eea926be5 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.311897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b653a-154d-4912-8fdd-dc1eea926be5 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.313375 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 14/24] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:49.320432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.323865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.324411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.363168 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:49.365187 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:49.366631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 11/25] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:34:49.368967 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:49.370612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:49.371139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:49.397828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:49.400173 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:49.486070 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:49.513661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:34:49.534911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:49.774240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:49.862338 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:49.870235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:49.902900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34b46-1039-4559-8f17-08e6ecc70f13 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.001400 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517edfe-0c2c-4d07-83aa-ba170815bc8b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.002318 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.003012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.003296 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.003569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.004262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.005708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d633f-16ec-436d-95a2-b0197f7b23a9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.040757 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.041896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.042384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.042852 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.054808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-ef26ac1e-9568-4bf6-84a8-d9f6d9268ab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:34:50.061511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:34:50.062366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:50.063114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:34:50.065344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 13/28] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:34:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:34:50.071295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd9ef-896b-4a80-9a63-e9d91292021b None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.071295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd9ef-896b-4a80-9a63-e9d91292021b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.071295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd9ef-896b-4a80-9a63-e9d91292021b None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.071685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 14/29] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:50.073754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdd9ef-896b-4a80-9a63-e9d91292021b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.150607 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:50.167625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 16/30] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Aug 20 20:34:49 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:34:50.169105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.169553 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.170012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.206015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:50.207610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:50.296327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:50.297180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.327795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdd9ef-896b-4a80-9a63-e9d91292021b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.387756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:50.440857 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85110f2-0e56-4cbe-871a-f26cc4501af0 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.445059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.447727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.448234 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.448749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.451270 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:50.451857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.455728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.484538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 15/32] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:50.490268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.520031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.520771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.522689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.544327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.547230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-b9517d55-248f-46b7-8d4e-5d13e420c72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:34:50.568377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:34:50.569301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:34:50.570142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:34:50.570142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:34:50.570142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:34:50.570632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 18/33] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:34:50.572054 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b186-890a-4218-a6eb-c028f6485b65 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.572514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b186-890a-4218-a6eb-c028f6485b65 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.577502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b186-890a-4218-a6eb-c028f6485b65 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.579233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 19/34] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:50.580211 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999b186-890a-4218-a6eb-c028f6485b65 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.627475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:50.635114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193689f-a780-4b81-8d53-8d34cc92a541 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.684416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.685316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.685715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.685992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.687522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.688982 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f405c-e2b6-433c-9cdd-92530a1d436e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.690606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 16/35] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:34:50 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:50.691711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6738a-68b8-451e-af84-a959ecd71839 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.691992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6738a-68b8-451e-af84-a959ecd71839 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.692265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6738a-68b8-451e-af84-a959ecd71839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.716234 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-88f6738a-68b8-451e-af84-a959ecd71839 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:50.717429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-88f6738a-68b8-451e-af84-a959ecd71839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:50.729166 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999b186-890a-4218-a6eb-c028f6485b65 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.749577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:50.770651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.771442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.771734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.772043 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.772706 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:50.773018 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.774474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.786235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:50.787483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359666-33d6-4c77-8e5a-4df20a617b8a None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.787767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359666-33d6-4c77-8e5a-4df20a617b8a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.788094 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359666-33d6-4c77-8e5a-4df20a617b8a None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.794252 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 18/37] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:50.794252 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9359666-33d6-4c77-8e5a-4df20a617b8a None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.794432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:50.794432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:50.902208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:50.914413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9359666-33d6-4c77-8e5a-4df20a617b8a None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.915097 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8eff-5041-4a93-aa9f-dc50bed814f6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:50.951533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.952367 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.952688 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.952925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.953893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:50.954110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.954523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.954810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.955088 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.955592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f0bf4-7ed9-408b-b252-89396fe679fa None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.955820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:50.962578 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:50.962706 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:50.962781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:50.962781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:50.962781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:50.976718 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Aug 20 20:34:50 2022] POST /identity/v3/roles => generated 225 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:34:50.979823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:50.981084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:50.989669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:51.033947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:51.064409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 20/41] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:51.065711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:51.140950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32d86-81d2-49fc-be9b-7e947e93702b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:51.181454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:51.182095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:51.182380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:51.182651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:51.183306 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:51.184885 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:51.196111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:51.209899 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ca1f0-bc33-4f74-8422-6752b3ef1f80 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:51.221986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:34:50 2022] POST /identity/v3/projects => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:34:51.222815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:51.256668 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:51.257489 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:51.257847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:51.258144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] PATH_INFO: `/v3/domains/default/users/8b4c21c326a741f8bc5b0a71851754ff/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:51.260934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8b4c21c326a741f8bc5b0a71851754ff, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:51.261901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:51.333884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:51.356908 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e1945-9b8d-4f08-a137-e0f2501c170a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:51.395498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:51.396361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:51.396747 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:51.397161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:51.398015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:51.399597 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:51.402239 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1361 bytes} [Sat Aug 20 20:34:51 2022] PUT /identity/v3/domains/default/users/8b4c21c326a741f8bc5b0a71851754ff/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:34:51.419275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:51.419973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Aug 20 20:34:51 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:34:51.553500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729762b-eeab-4079-8ef3-737681d2662a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:51.594799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:51.595497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:51.595781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:51.596057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:51.598103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:51.600026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6b999-eb87-4b01-89e4-00c9fdf6e2f3 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:51.606035 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 22/45] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:51.611388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:51.717743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fea23-0ea7-46a2-b77d-a8662408c9f7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:51.750011 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:51.750629 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:51.750912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:51.751186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:51.751837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:51.753297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67094a-476b-4fe5-a408-7712426e6796 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:51.775400 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:51.782228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:34:51 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:34:53.590421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adde4-5812-457a-9d3d-2bedf33047c0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:53.590950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adde4-5812-457a-9d3d-2bedf33047c0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:53.590950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adde4-5812-457a-9d3d-2bedf33047c0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:53.592417 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:53.597661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201eda0-3b88-493b-9f4c-f3b14bf08f39 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:53.598067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201eda0-3b88-493b-9f4c-f3b14bf08f39 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:53.598208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201eda0-3b88-493b-9f4c-f3b14bf08f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:53.617556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-6201eda0-3b88-493b-9f4c-f3b14bf08f39 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:53.618808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-6201eda0-3b88-493b-9f4c-f3b14bf08f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:53.688684 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:53.965388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d00cd-53fb-4b4b-ba61-61f7be3a201d None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:53.965697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d00cd-53fb-4b4b-ba61-61f7be3a201d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:53.966008 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d00cd-53fb-4b4b-ba61-61f7be3a201d None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:53.967381 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 24/49] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:53.972813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:53.973105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:53.973386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:53.992791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:53.994008 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:54.012460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d00cd-53fb-4b4b-ba61-61f7be3a201d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.032148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:54.062939 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:54.119451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d00cd-53fb-4b4b-ba61-61f7be3a201d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.154247 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.154891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.155176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.155451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.167828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:34:54.172588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:34:54.173534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:34:54.174558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:34:54.179719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.239842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:54.280141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aeeb7-fe6a-4265-a8cf-afaaddafee8e None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.317108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.317776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.318053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.318322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.319140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:54.319448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.322021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.330637 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:54.336729 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.378402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.419675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:54.441292 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6252-843d-4ef2-8992-298ac98d298d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.474346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.474980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.475263 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.475540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.476777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.477772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df19ab-f6e4-4e1e-8d07-280af201801f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.478286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.480103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:54.485348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.501820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:54.513814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.514481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.514737 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.515016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.516147 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.517601 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.519341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:54.524593 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.584831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9673b1-a64e-4bfb-bb54-a598e765aa17 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.618781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.619366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.619653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.619933 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.621083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.622340 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a06f-719b-4ae5-9330-3ece33b877ea None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.622723 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.624171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:54.629957 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:54.645693 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:54.672228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.672853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.673135 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.673417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.674252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.680273 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21771-7722-4fdf-87db-f291570f0f6b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.705736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 29/56] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Aug 20 20:34:54 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:34:54.740667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca876f-3dd9-43d4-b088-13499f54c6b1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:54.777402 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:54.777975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:54.778266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:54.778544 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:54.779295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.domain.id=default, user.id=8b4c21c326a741f8bc5b0a71851754ff) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:34:54.779611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:54.781102 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be3cfe-624a-4451-8b45-26b2cf962678 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:54.790240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1322 bytes} [Sat Aug 20 20:34:54 2022] GET /identity/v3/role_assignments?user.id=8b4c21c326a741f8bc5b0a71851754ff&scope.domain.id=default&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:34:56.864725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8535-8ce1-49a2-8265-e72b12bf7cc4 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:56.865263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8535-8ce1-49a2-8265-e72b12bf7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:56.865263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8535-8ce1-49a2-8265-e72b12bf7cc4 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:56.866657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:34:56.875670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:56.876386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:56.876538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:56.898979 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:34:56.900517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:34:56.968093 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:34:57.283274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8535-8ce1-49a2-8265-e72b12bf7cc4 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:57.336376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:57.395532 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8535-8ce1-49a2-8265-e72b12bf7cc4 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:57.430679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:57.431314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:57.431604 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:57.431881 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:57.433105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:57.434639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d944b0-f607-44d6-b0a2-20479ec7efa6 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:57.436219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:34:57.442576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:34:57.458097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:34:57.549901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e27afd-8e81-4aa7-a794-841923689052 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:34:57.585426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:34:57.586061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:34:57.586341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:34:57.586625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:34:57.587261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:34:57.588761 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f742e5-272a-46b8-b2a5-7421657f0e3d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:34:57.621266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:34:57 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:00.868342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d368052-6264-4f33-b984-f2c5f242b92f None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:00.868856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d368052-6264-4f33-b984-f2c5f242b92f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:00.868936 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d368052-6264-4f33-b984-f2c5f242b92f None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:00.870481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:00.887534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb727-1a38-490e-995c-0659ac7e0084 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:00.888422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb727-1a38-490e-995c-0659ac7e0084 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:00.888891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb727-1a38-490e-995c-0659ac7e0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:00.917837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-017fb727-1a38-490e-995c-0659ac7e0084 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:00.919417 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-017fb727-1a38-490e-995c-0659ac7e0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:01.002969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:01.011736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:01.060462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b781a-a632-4d73-95fc-190fe49ac5b4 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.061241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b781a-a632-4d73-95fc-190fe49ac5b4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.061776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b781a-a632-4d73-95fc-190fe49ac5b4 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.063398 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 33/64] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:01.069653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12ea0-88d6-4b75-8a34-bd272b58ce7b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.069969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12ea0-88d6-4b75-8a34-bd272b58ce7b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.070227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12ea0-88d6-4b75-8a34-bd272b58ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.094637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d7e12ea0-88d6-4b75-8a34-bd272b58ce7b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:01.095851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d7e12ea0-88d6-4b75-8a34-bd272b58ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:01.186521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:01.244997 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecf2-aa02-48cf-a4a9-494fb9ca9ebd None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.245645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecf2-aa02-48cf-a4a9-494fb9ca9ebd None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.246123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecf2-aa02-48cf-a4a9-494fb9ca9ebd None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.247855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 34/66] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:01.253334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2622-9137-4e52-8aec-e0296f7ecfb2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.253649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2622-9137-4e52-8aec-e0296f7ecfb2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.253950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2622-9137-4e52-8aec-e0296f7ecfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.277818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-b94e2622-9137-4e52-8aec-e0296f7ecfb2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:01.279013 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-b94e2622-9137-4e52-8aec-e0296f7ecfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:01.380241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:01.476313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236354b-cb0d-48d2-b8a6-d041498d7d98 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.476766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236354b-cb0d-48d2-b8a6-d041498d7d98 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.476766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236354b-cb0d-48d2-b8a6-d041498d7d98 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.478301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 35/68] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:01.493814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.494107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.494389 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.513971 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236354b-cb0d-48d2-b8a6-d041498d7d98 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:01.518261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:01.519728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:01.599298 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:01.621205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:01.622412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:01.650686 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236354b-cb0d-48d2-b8a6-d041498d7d98 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:01.662447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:01.688561 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:01.689346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.689702 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.690021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.703300 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-29e337df-5fb4-4aa2-b1f9-228635b5a63f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:01.708314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:01.709155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:01.710301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:01.717638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802309c0-2587-4772-bb68-1cbdb26567c3 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.717638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802309c0-2587-4772-bb68-1cbdb26567c3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.717638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802309c0-2587-4772-bb68-1cbdb26567c3 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.717638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 37/71] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:01.717638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802309c0-2587-4772-bb68-1cbdb26567c3 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:01.752312 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69da0a1-8ccc-404d-bc7b-d375265e346b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:01.794278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:01.794921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.795212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.795488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.806285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-19ea5041-d5fb-4590-9fa3-28cc7afe2d3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:01.811906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:01.812766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:01.813580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:01.814871 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.814936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.815186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.832197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:01.833405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:01.837756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802309c0-2587-4772-bb68-1cbdb26567c3 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:01.875551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:01.875994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:01.877209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:01.877419 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:01.877793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:01.878510 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:01.878815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:01.880484 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:01.891595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:01.891595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:01.917655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:01.917655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:01.947724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.023537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f41c79-8296-49c8-af28-e0f39ead797d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.028291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739020-fd3e-45c3-a5f8-4c8d11e4ac68 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.059535 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.060159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.060447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.060759 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.061437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:02.061777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.063220 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.064884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.065544 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.065840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.066115 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.071991 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.072742 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.081092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:02.086233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:02.087075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:02.087826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:02.088480 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.115498 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.182798 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.184048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8d94-5f43-463b-a7a5-da337da90850 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.191948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7a66-ec86-48e3-b94a-222ceec13396 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.221162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.221824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.222111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.222373 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.228340 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.229057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.229309 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.229582 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.237308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.238820 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.240449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.241091 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:02.241195 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:02.247038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:02.247916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:02.248671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:02.249381 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.339171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.345142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aec0-7559-4c5c-94c0-e732d6c47759 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.346914 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490f04-f026-4efc-9e68-0e62eec82e66 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.380168 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.380397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.380803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.381013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.381123 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.381293 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.381378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.381562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.382256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:02.382499 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.382588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.383929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.384013 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.385587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.386377 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.392146 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.393007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.410529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.489187 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b4bc-e7b4-4a20-b661-6365aa610c40 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.494176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4a709-75f6-4b51-9571-50ccb71e4a44 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.522215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.522881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.523169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.523448 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.524550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.526137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.526299 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.526914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.527199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.527496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.527712 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.528480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.556972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.593704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.595148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.608883 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.625841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20189-0167-40da-8b10-89f367d28777 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.658597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.659253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.659531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.659809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.660478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:02.660833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.662255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.670176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.670965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.692078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:02.692921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.765868 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.776109 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db74a9-9c17-4c07-8c22-4f475e184c07 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.791853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb402-7e48-461f-8989-2b0c5f139820 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.806560 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.810103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.810727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.811015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.811295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.826797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.827437 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.827715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.827988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.829149 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.830639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.832412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 43/84] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:02.832936 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:02.880999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.882361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.931934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558a8-9338-4bb1-a302-0fdee13616c0 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:02.967295 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:02.967911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:02.968189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:02.968466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:02.969119 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:02.970617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:02.971862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:02.980949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:02.981846 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.002243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 44/86] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:02 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:03.003084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.056928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.090030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1fcf6-7fca-4329-896b-a8a0f6ea461a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.128213 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfdf37-129a-42a5-9f20-326fbdee0956 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.131487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.132092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.132386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.132668 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.134012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.135733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.141985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 43/87] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:02 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.141985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.173244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.173934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.174222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.174502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.175748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.177121 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.178810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 45/88] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.179674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.204649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.256411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376d60-77c4-41b7-b26b-611cde5bf630 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.302299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.302516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.303619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.303619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.306028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86913-83b4-429b-970c-5db377c51451 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.316216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.353238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.353950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.354235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.354522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.356189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.357708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.359718 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 46/89] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.360578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.392220 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.394124 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.473250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.481526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629b06-38b2-4e23-af80-6150f807ce1f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.522505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 44/90] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:03.523362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.532117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.534155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.534155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.534155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.579281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.607271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.608999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.625554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17901f-8cf2-4d04-a271-051dd80b30e5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.661651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.662217 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.662529 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.662779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.663951 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:03.664271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.666047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.674340 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.675231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.710646 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.718816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:03.724947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.804746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8659-e6f5-481a-b94a-1f57b2e2937a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.810091 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.834184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f2e1-6a5a-4c84-b3ac-e58e7007e908 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:03.843514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.844136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.844421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.844700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.845439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=8b4c21c326a741f8bc5b0a71851754ff) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:03.845787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.847277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.853166 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/role_assignments?user.id=8b4c21c326a741f8bc5b0a71851754ff&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.854177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.873957 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:03.874782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:03.875089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:03.875425 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:03.876669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:03.878288 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:03.879931 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:03.886763 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:03.952573 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:03.966763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996582-f6ca-4b34-8536-eff17762f089 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:04.004785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:04.005465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:04.005781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:04.006067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] PATH_INFO: `/v3/projects/91b3bd6af26448789ba07615da78e730` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:04.007261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] RBAC: Authorizing `identity:get_project(project_id=91b3bd6af26448789ba07615da78e730)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:04.008909 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:04.010840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/projects/91b3bd6af26448789ba07615da78e730 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:04.016856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:04.122413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad14e-2534-4d40-8720-05a223c8e168 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:04.143787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e909fe-33dc-452b-aa09-1533af43d596 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:04.159457 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:04.160185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:04.160539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:04.160888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:04.161723 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=91b3bd6af26448789ba07615da78e730, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:04.162127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:04.164042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7f70-5d9a-4de3-8dac-0072c09c6907 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:04.170287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:04 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=91b3bd6af26448789ba07615da78e730&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:04.217576 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:04.218497 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:04.218925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:04.219341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:04.220234 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] RBAC: Adding query filter params (role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:04.220703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:04.222432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f86f-10b3-426d-b286-e23bdcff122d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:04.234430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:03 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:06.031378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83d40-7ea7-4559-9d92-80b6051c5941 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.031946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83d40-7ea7-4559-9d92-80b6051c5941 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.031946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83d40-7ea7-4559-9d92-80b6051c5941 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.033432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:06.038701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.039491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.039983 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.053501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e56f-315f-4907-a569-fa5e4122ea5e None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.053823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e56f-315f-4907-a569-fa5e4122ea5e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.054111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e56f-315f-4907-a569-fa5e4122ea5e None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.055576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 50/99] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:06.056529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:06.062065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.062358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.062639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.062912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:06.064649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:06.092340 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:06.093570 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:06.122117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:06.187136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:06.203825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:06.608821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:06.723867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a90c8-8800-4730-8d10-e6e1b43e2ffb None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:06.778478 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:06.779189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.779475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.779750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.782548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:06.790987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:06.798405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:06.799281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:06.800126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:06.807076 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:06.876315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:06.930185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71faf7-650a-4d1d-afa0-43d5d80df08d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:06.967271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:06.967891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.968169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.968485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.969154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:06.969456 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:06.970886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a91876-50be-47fe-ad7e-422ad6dc3857 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:06.979431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 52/103] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:06.980812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe060d8-c14f-401d-a036-e3cab9312409 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.981098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe060d8-c14f-401d-a036-e3cab9312409 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.981376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe060d8-c14f-401d-a036-e3cab9312409 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.982592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 53/104] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:06.987285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223c3d-2603-4345-84cf-8f4e3d4701e2 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:06.987285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223c3d-2603-4345-84cf-8f4e3d4701e2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:06.987285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223c3d-2603-4345-84cf-8f4e3d4701e2 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:06.987285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 54/105] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:06.987285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48223c3d-2603-4345-84cf-8f4e3d4701e2 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.003149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.019941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7a00-451a-48b6-8677-9d7845753f9d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.073367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.075504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.075941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.076439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.078612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.080850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb0b3-cbb7-4fda-b154-3e61723dde53 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.083025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:07.084410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.085765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.086202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.099946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48223c3d-2603-4345-84cf-8f4e3d4701e2 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.112271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:07.113941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:07.137843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.138574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.138970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.139341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] PATH_INFO: `/v3/users/57e19f172db149ca9171df3fb54a634d` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.154650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] RBAC: Authorizing `identity:get_user(user_id=57e19f172db149ca9171df3fb54a634d)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.156268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d337-103d-4dd0-ad14-2edc2d05c595 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.158477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 55/107] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:06 2022] GET /identity/v3/users/57e19f172db149ca9171df3fb54a634d => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:07.159869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.160213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.160546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.179964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:07.181244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:07.194591 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.204178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 53/108] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:07.205260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.278305 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.288730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:07.297643 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.332217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0264-4f76-4e30-b0fc-1b0a1aad9774 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.402898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.403885 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.404481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.404956 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.405932 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.407611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.437765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161bd59-0bc6-4340-b402-c41d217acc0a None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.459183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 54/110] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:35:07 2022] POST /identity/v3/projects => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:07.504366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.505144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.505428 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.505727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.567190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.594620 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.596707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.597545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.658951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.711013 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:07.718808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.737913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951cc2-293b-4684-91c8-b597af73ec2a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.778803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.779653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.779950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.780233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.792717 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:07.799038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:07.799921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:07.800683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:07.806355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.847784 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.851473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b8f6-73bf-4873-a125-64d048c71dc2 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.892272 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.893325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.893835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.894310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.895914 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.897881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.900077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:07.905969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:07.925903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58662-cc22-4248-ae40-d7b94eb8ef50 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:07.935431 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:07.972989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:07.973660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:07.973940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:07.974217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:07.974901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:07.975208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:07.977913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:07.988389 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 56/114] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:07.989321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.044016 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fef24-3bdd-4de6-ad20-ed81cb1e8dd9 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.081812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.082437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.082719 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.082995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.084146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=57e19f172db149ca9171df3fb54a634d) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:08.084467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.086510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.092617 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 59/115] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/role_assignments?user.id=57e19f172db149ca9171df3fb54a634d&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:08.094882 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.116070 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04109d-61ee-4abe-9ab9-14c9594a4491 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.146299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.161838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.163135 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.163654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.164139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.177707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-7dc481ac-5923-4b57-aa0c-bea2cdd4a146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:08.183356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:08.184310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:08.185221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:08.187986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:08.195154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24d9b-d799-4245-a070-93bed10d9cfb None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.195910 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24d9b-d799-4245-a070-93bed10d9cfb None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.196386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24d9b-d799-4245-a070-93bed10d9cfb None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.198568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 58/117] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:08.204281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736506-5541-4303-ad66-ddc8eb56e3e6 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.204828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736506-5541-4303-ad66-ddc8eb56e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.205405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736506-5541-4303-ad66-ddc8eb56e3e6 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.207083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 59/118] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:08.208505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736506-5541-4303-ad66-ddc8eb56e3e6 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.241161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.243142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8005d6-9f50-416e-b68f-c1332a1e2ada None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.294934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.295591 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.295875 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.296155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.297331 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.299360 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8c6ca-0cdc-4203-88d3-9e3df784fc63 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.301726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:08.303304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.303607 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.304152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.333774 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736506-5541-4303-ad66-ddc8eb56e3e6 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.336224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:08.338285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:08.381437 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.382483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.382979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.383898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.384790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:08.385363 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.387671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715198f-d342-40a9-af63-04882fbe9cc8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.400202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:08.401816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.402328 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.402803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.418524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:08.425476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:08.426645 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.428107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:08.483368 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.514588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 61/122] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:08.515896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.542316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.628142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9489-86a0-434d-93ff-23394ee4c6f3 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.648474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4810083-79f8-45f8-b59c-1c68165d9456 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.665494 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.666550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.667043 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.667641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.669108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.670808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.672603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:08.678410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.735232 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.736010 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.736196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.736442 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.742411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.743916 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.745720 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:08.751595 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.786152 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.801669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fa952-df9b-411f-b8dd-cd6df073f3bb None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.844597 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.845667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.846164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.846635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.848127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.849804 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.852464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:08.853461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:08.910491 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:08.914634 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907cc0-6e34-4c59-aff9-e843f4fe8773 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:08.950333 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:08.951168 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:08.951611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:08.951985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/9741b954d54c450cae582dc4de0ecb97/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:08.954120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, user_id=9741b954d54c450cae582dc4de0ecb97, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:08.955789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:08.988491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120a10-9843-4861-89b7-f42f9110b102 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.000845 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:08 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/9741b954d54c450cae582dc4de0ecb97/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:35:09.001929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.031025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.032016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.032642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.033244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.046860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:09.052819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:09.053761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:09.054531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:09.057641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:09.067212 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.102596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:09.167654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677762-88e4-488f-b640-06ba81d279f0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.209073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.210022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.210316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.210597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/8b4c21c326a741f8bc5b0a71851754ff/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.212672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, user_id=8b4c21c326a741f8bc5b0a71851754ff, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:09.214317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:09.233884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:09 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/8b4c21c326a741f8bc5b0a71851754ff/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:09.234974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.266320 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:09.297183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ca7e-8e53-4aba-8451-90d251bb42c7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.339077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.339714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.339997 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.340275 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.340968 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:09.341276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:09.344269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:09.355970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:09.366732 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.443620 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832322-3e9b-436a-b171-c4e102f2f3ab None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.516159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:09.539402 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.540072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.540354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.540632 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.552123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79057-cbac-4bbd-a7c0-19c4cfe2e9b8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.570612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:09.575638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:09.576601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:09.577378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:09.586559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.598472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.599146 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.599434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.599716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.601133 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:09.602683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:09.604658 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:09.610398 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.721139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aea31-71c5-4aba-870e-97dcccd33ee8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.757339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.759151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.759151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.759151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] PATH_INFO: `/v3/projects/91b3bd6af26448789ba07615da78e730` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.760254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] RBAC: Authorizing `identity:get_project(project_id=91b3bd6af26448789ba07615da78e730)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:09.761969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:09.764035 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 67/132] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/projects/91b3bd6af26448789ba07615da78e730 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:09.769870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.782015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:09.805988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:09.826115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7792be-a285-4451-8f7d-395405730971 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:09.894970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:09.895609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:09.895898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:09.896228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:09.896913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:09.897224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:09.898997 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:09.917925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 66/133] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:09.923598 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:09.968108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530936-2b14-4147-a1af-cb58343f33d9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:10.010524 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:10.011212 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.011505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.011891 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] PATH_INFO: `/v3/projects/91b3bd6af26448789ba07615da78e730/users/9741b954d54c450cae582dc4de0ecb97/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.014044 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=91b3bd6af26448789ba07615da78e730, user_id=9741b954d54c450cae582dc4de0ecb97, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:10.015638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:10.034787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 68/134] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:09 2022] PUT /identity/v3/projects/91b3bd6af26448789ba07615da78e730/users/9741b954d54c450cae582dc4de0ecb97/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:35:10.085857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1508-fc17-4012-b8db-0a75932e7fd6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:10.124879 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:10.125543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.125862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.126147 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.127427 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:10.129032 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:10.130793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 67/135] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:09 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:10.139003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:10.222694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:10.250131 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3cb2-b479-43de-834d-d77e13ff8a69 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:10.287672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:10.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.288534 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.288814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.290107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:10.291704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606c662-d6fd-40a2-9abe-54cbeffea763 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:10.293472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 69/136] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:10 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:10.299631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:10.312954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:10.416772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ebd0b-305a-4430-a7e3-ecb092c3c472 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:10.452327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:10.453083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.453423 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.453834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/9741b954d54c450cae582dc4de0ecb97/roles/c215809d75234d1da0f9b9bd6cc13fb5` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.456155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, user_id=9741b954d54c450cae582dc4de0ecb97, role_id=c215809d75234d1da0f9b9bd6cc13fb5)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:10.457667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec0057-bdd6-4992-a4e8-8913f17eacc4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:10.474603 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:10 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/9741b954d54c450cae582dc4de0ecb97/roles/c215809d75234d1da0f9b9bd6cc13fb5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:10.711561 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd8e4-0f53-4ab5-9455-72cb76a6bed7 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.712089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd8e4-0f53-4ab5-9455-72cb76a6bed7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.712166 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd8e4-0f53-4ab5-9455-72cb76a6bed7 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.713523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 70/138] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:10.718967 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8856f-1832-48f3-83b0-c55f40f4274b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:10.719261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8856f-1832-48f3-83b0-c55f40f4274b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:10.719537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8856f-1832-48f3-83b0-c55f40f4274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:10.739637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-85e8856f-1832-48f3-83b0-c55f40f4274b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:10.740832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-85e8856f-1832-48f3-83b0-c55f40f4274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:10.810833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:10.816459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:11.093336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cc3d-3f81-4f98-a72a-3cd71fc2c011 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:11.093520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cc3d-3f81-4f98-a72a-3cd71fc2c011 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:11.093836 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cc3d-3f81-4f98-a72a-3cd71fc2c011 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:11.095179 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 71/140] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:11.100545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:11.100838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:11.101117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:11.124262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:11.125465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:11.203004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 70/141] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:11.371165 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927cc3d-3f81-4f98-a72a-3cd71fc2c011 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:11.498040 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927cc3d-3f81-4f98-a72a-3cd71fc2c011 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:11.539228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:11.539879 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:11.540158 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:11.540432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:11.541573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:11.543198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:11.544963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 72/142] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:11.550219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:11.681313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:11.686246 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c260c-e390-40b2-8f28-fc904f6e2f94 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:11.705140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:11.729724 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:11.744163 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:11.744851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:11.745137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:11.745419 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:11.746123 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:11.747609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:11.795072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 71/143] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:11 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:11.853302 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0479-4002-41a0-93e1-dd36549ef551 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:11.894295 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:11.895236 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:11.895659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:11.896102 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:11.914021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:11.919813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:11.920925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:11.921903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:11.923964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 73/144] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:11.930790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:12.086656 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb65ef-1a6b-4c6e-a55b-90f3d40f9e9f None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:12.147251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:12.147921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.148214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.148496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.149212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:12.149528 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:12.151103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960b06-387b-46b1-bcee-777b11a771dc None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:12.160934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 72/145] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:12.166711 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:12.256590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:12.290694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45d6d-1a2b-4f14-ba2a-bb0d751bb0fb None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:12.330041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:12.330692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.330965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.331233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] PATH_INFO: `/v3/users/57e19f172db149ca9171df3fb54a634d` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.332381 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] RBAC: Authorizing `identity:get_user(user_id=57e19f172db149ca9171df3fb54a634d)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:12.333884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:12.335998 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 74/146] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:12 2022] GET /identity/v3/users/57e19f172db149ca9171df3fb54a634d => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:12.336344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78d96-de72-4556-96e7-45bb4e3961c7 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.337022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78d96-de72-4556-96e7-45bb4e3961c7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.337494 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78d96-de72-4556-96e7-45bb4e3961c7 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.343137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 73/147] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:12.344017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:12.344902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.345399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.345904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.377645 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:12.378838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:12.461514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:12.511315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 74/148] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:12.520421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747115a-d1b9-40d9-a949-8bbce6ea7299 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:12.558301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:12.558955 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.559238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.559511 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.562329 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:12.564016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fcada-4598-41d7-9796-e3becf5f942b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:12.565967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 75/149] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:12 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:12.572109 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:12.691342 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70361b88-858e-42f8-af7b-9a1757ad0694 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:12.733391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:12.734536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.735017 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.735477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/57e19f172db149ca9171df3fb54a634d/roles/892631c0d62d4759bcb78c7dfd53e451` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.737778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, user_id=57e19f172db149ca9171df3fb54a634d, role_id=892631c0d62d4759bcb78c7dfd53e451)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:12.739440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638a8e-fc1c-4d9a-b9b8-5a333df326d4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:12.768148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:12 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/users/57e19f172db149ca9171df3fb54a634d/roles/892631c0d62d4759bcb78c7dfd53e451 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:12.980645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a41-fbe8-4e72-bbe1-29f8e32452e9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.981563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a41-fbe8-4e72-bbe1-29f8e32452e9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.982096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a41-fbe8-4e72-bbe1-29f8e32452e9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:12.983635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 76/151] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:12.989478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:12.990099 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:12.990563 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.011042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:13.012583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:13.052089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:13.090674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66a41-fbe8-4e72-bbe1-29f8e32452e9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:13.101379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:13.115411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 76/152] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:13.232450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66a41-fbe8-4e72-bbe1-29f8e32452e9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:13.275732 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:13.276390 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.276670 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.276948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.291104 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:13.296359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:13.297226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:13.298031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 77/153] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:13.305790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:13.459053 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a0e87-5dfb-4537-932d-3ce087076848 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:13.498116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:13.498658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.498936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.499207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.499870 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:13.500169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:13.501555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:13.513522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 77/154] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:13.519318 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:13.602282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:13.636509 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:13.647476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b73bb-42f2-42a4-a61c-cefcb38ea122 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:13.685731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:13.693070 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:13.693578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.693954 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.694581 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.697639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:13.697639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637465b-65ce-479c-a086-bd356dbdad1a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:13.701905 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 78/155] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:13 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:13.707485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dc6e7-26b2-4b8a-a8c6-8e7be5cff370 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.707762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dc6e7-26b2-4b8a-a8c6-8e7be5cff370 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.708036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dc6e7-26b2-4b8a-a8c6-8e7be5cff370 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.709402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 79/156] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:13.712294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dc6e7-26b2-4b8a-a8c6-8e7be5cff370 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:13.814392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327b101-b7fc-4e0b-8c48-fcfbab6084ad None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:13.821570 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dc6e7-26b2-4b8a-a8c6-8e7be5cff370 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:13.863298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:13.863927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.864204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.864474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.869978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:13.876034 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:13.876690 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.876974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.877248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.895208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-a115ca64-5ef4-4577-bd6b-812d2bdb250e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:13.908701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:13.909908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:13.910801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:13.914862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:13.915154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:13.915432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:13.941924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:13.943418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:13.954681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:13.955900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:14.045380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:35:14.046105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.071946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 79/159] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:14.072928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.080639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:14.104735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:14.151998 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a305c9e-77a3-4ea4-8b27-e05840f423d9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:14.188677 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:14.189680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.190197 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.190602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.191567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:14.192017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:14.193537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1579e-3dd1-4a17-83d4-ac07d28ace3a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:14.203053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 81/160] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:14.204619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a15f-51c5-4e9a-bf50-41dcdd08f6c6 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.205156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a15f-51c5-4e9a-bf50-41dcdd08f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.205585 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a15f-51c5-4e9a-bf50-41dcdd08f6c6 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.211745 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 82/161] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:14.213688 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a15f-51c5-4e9a-bf50-41dcdd08f6c6 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.316540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf577db-fd30-45e7-bc60-aa067fdf82a8 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:14.320743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:14.329004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a15f-51c5-4e9a-bf50-41dcdd08f6c6 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:14.377584 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:14.378324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:14.378874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.378996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.379254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.379528 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.379900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.380442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] PATH_INFO: `/v3/users/8b4c21c326a741f8bc5b0a71851754ff` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.380765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:14.381981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4c21c326a741f8bc5b0a71851754ff)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:14.382269 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba8c79-dec6-4e69-a7db-856b78e2e658 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:14.383916 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 80/162] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:14.384017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:14.385895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/users/8b4c21c326a741f8bc5b0a71851754ff => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:14.388786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.388786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.388786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.391651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.422631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:14.423853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:14.501709 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3b760-e1d5-4887-86a1-8127df1d46e1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:14.535318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 81/164] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:14.536345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.541835 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:14.542780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.543314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.543797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.544869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:14.545395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:14.547285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:14.554254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 84/165] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:14.570215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:14.662395 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff93b-984d-4b48-b3bf-cc24bfee21a4 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:14.701170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:14.701830 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:14.702114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:14.702388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:14.789073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:14.790615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:14.812701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:14.888787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.912780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:14.922361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:14.943670 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.034021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7ccc-4f4b-4dc2-ad69-3a4f975205d5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.037473 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de25d1-009e-405a-93da-cde11c93ee1a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.052085 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.076796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.077452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.077736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.078012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.081672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.082395 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.082673 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.082945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.086579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.088183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.089585 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:15.090218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:15.098218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:15.099181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:15.100515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:15.105327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.106715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.199890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.213492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747865-043c-4112-90f1-70a6a012dc33 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.217907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41716abf-0f93-4e23-acac-64db0f1822a7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.250877 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.251501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.251779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.252052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.252946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=8b4c21c326a741f8bc5b0a71851754ff) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:15.253257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.254744 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.261190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/role_assignments?user.id=8b4c21c326a741f8bc5b0a71851754ff&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:15.275602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.276327 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.276609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.276889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.277578 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:15.277917 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.279355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.289066 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 84/170] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:15.294807 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.430320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860162fa-b6f2-4571-a1c6-2e9c1a6b4341 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.467155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.467736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.468014 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.468283 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.469440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.470933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.472502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:15.478218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.507157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.546140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.553733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.637779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17972aab-bf9d-429d-8c4a-be55828d1920 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.652692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17901a-f8d1-4ea6-af89-d6d36838c32a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.695257 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.696033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.696204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.696438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.710899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.711558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.711842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.712114 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.723214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:15.728313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:15.729282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:15.730136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:15.737208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.850016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:15.879980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09950-9fa7-4616-a813-41f214e49af7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:15.894448 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.895976 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.915705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:15.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:15.919044 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:15.919366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:15.920067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:15.920380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:15.921812 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:15.930442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 89/173] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:15.938650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:15.973522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:16.038526 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 85/174] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:16.044777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:16.157140 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b383c-d428-491a-8aef-c8b9d1392ac5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:16.163707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8578-61a2-42c3-9967-24a4239a80e2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:16.211881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:16.212548 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.212828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.213107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] PATH_INFO: `/v3/projects/91b3bd6af26448789ba07615da78e730` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.215696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] RBAC: Authorizing `identity:get_project(project_id=91b3bd6af26448789ba07615da78e730)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:16.217459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:16.219247 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 86/175] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:16 2022] GET /identity/v3/projects/91b3bd6af26448789ba07615da78e730 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:16.225432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:16.237780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:16.238424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.238701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.238973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] PATH_INFO: `/v3/users/9741b954d54c450cae582dc4de0ecb97` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.240094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] RBAC: Authorizing `identity:get_user(user_id=9741b954d54c450cae582dc4de0ecb97)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:16.241549 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:16.243289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 90/176] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:15 2022] GET /identity/v3/users/9741b954d54c450cae582dc4de0ecb97 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:16.249167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:16.254279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:16.277446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:16.403888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d08cb5-0d08-4857-b41d-7d5fb646a683 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:16.468169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:16.468797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.469079 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.469354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.474369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=91b3bd6af26448789ba07615da78e730, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:16.474689 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:16.476265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a69b8-ed73-4146-b238-1382bec54e3a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:16.488518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 87/177] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:16 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=91b3bd6af26448789ba07615da78e730&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:16.536277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f42c6c-f03c-4305-ba2c-979ef940cd0a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:16.572476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:16.573164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.573442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.573733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.683988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:16.685498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:16.698123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:16.743253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734a72-cebb-4e15-b562-657116c80c78 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.743772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734a72-cebb-4e15-b562-657116c80c78 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.743772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734a72-cebb-4e15-b562-657116c80c78 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.745189 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 88/178] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:16.755193 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f15b4-9ca1-4c4a-9035-56ffc61c45cf None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.755534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f15b4-9ca1-4c4a-9035-56ffc61c45cf None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.755748 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f15b4-9ca1-4c4a-9035-56ffc61c45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.802196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d12f15b4-9ca1-4c4a-9035-56ffc61c45cf None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:16.803413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d12f15b4-9ca1-4c4a-9035-56ffc61c45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:16.818653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 91/179] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:16.826473 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:16.925767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 89/180] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:16.952064 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b488-34b6-474b-9f2b-0c0a19c28c21 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.952369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b488-34b6-474b-9f2b-0c0a19c28c21 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.952625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b488-34b6-474b-9f2b-0c0a19c28c21 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.954335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 90/181] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:16.956399 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341f8c-284f-4972-9f4a-560e8404241a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:16.961660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:16.961954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:16.962228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:16.991021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:16.992244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:16.994025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:16.997939 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:17.024897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.025554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.026148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.026459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.029751 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:17.031985 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:17.037659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 92/182] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:16 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:17.041302 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.149268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 91/183] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:17.194653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab594b3-1b44-49c7-a911-2632118e48ab None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:17.229567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.230434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.230938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.231349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.232214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] RBAC: Adding query filter params (role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=9741b954d54c450cae582dc4de0ecb97) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:17.232661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:17.234268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43730d12-6beb-4a0d-b51b-0b792b48bdcf None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:17.240762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 93/184] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/role_assignments?user.id=9741b954d54c450cae582dc4de0ecb97&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:17.283887 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.434619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe122a-cb4b-43cf-ba69-9dae7f321eb5 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:17.468689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe57f-7c0a-4e7d-829a-2996f0a4bb63 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.468689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe57f-7c0a-4e7d-829a-2996f0a4bb63 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.468689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe57f-7c0a-4e7d-829a-2996f0a4bb63 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.470040 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 94/185] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:17.475458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e909-2039-4ebd-a926-090f5d16913a None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.475725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e909-2039-4ebd-a926-090f5d16913a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.475999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e909-2039-4ebd-a926-090f5d16913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.489853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.490521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.490795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.491062 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.498374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:17.498695 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-d1c4e909-2039-4ebd-a926-090f5d16913a None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:17.500304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d1c4e909-2039-4ebd-a926-090f5d16913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:17.502390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-006fce6b-4ed0-4a5d-ab99-1cd7a39467c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:17.509251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:17.510222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:17.511002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:17.514276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 92/186] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:17.516840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39273c-5572-4f63-a71b-b59185597a1c None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.517097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39273c-5572-4f63-a71b-b59185597a1c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.517360 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39273c-5572-4f63-a71b-b59185597a1c None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.519073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 93/187] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:17.523983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39273c-5572-4f63-a71b-b59185597a1c None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.546672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:17.591963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 95/188] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:17.593234 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.593522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.593997 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.611484 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:17.612659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:17.647160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39273c-5572-4f63-a71b-b59185597a1c None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:17.693643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 96/189] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:17.693643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.696449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.697401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.697764 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.698591 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.699759 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:17.700075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:17.702053 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:17.712524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 94/190] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:17.718508 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.783987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:17.787757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311330b-f567-4bca-9278-fec3a16855e8 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:17.789440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:17.824092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.824755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.825117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.825442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.838830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:17.840336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6201e-64c8-4e95-9119-579f27f89b0b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:17.843770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:17.844748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:17.845543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 97/191] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:17.851218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.894337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:17.895280 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:17.896182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:17.896667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:17.914261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:17.915766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:17.917547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 95/192] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:17.918317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:17.968158 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35612f-784d-4910-9e3a-3db9c2f24454 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.004741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.005708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.006161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.006569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.007418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:18.007920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.009577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.017004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37343-6f3e-474f-8e64-6e1df00a198b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.018493 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 98/193] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:18.019438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.039199 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.045080 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.056906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.057538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.057853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.058130 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.068273 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:18.073009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:18.074043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:18.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 96/194] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:18.078447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.122823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a384e-2103-47b0-891d-f0a529c953b5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.155248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.155855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.156136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.156410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.179200 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fed2f-6fb4-4606-85a9-77f04bdf8b97 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.211659 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.212276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.212554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.212828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] PATH_INFO: `/v3/users/57e19f172db149ca9171df3fb54a634d` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.214022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] RBAC: Authorizing `identity:get_user(user_id=57e19f172db149ca9171df3fb54a634d)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.215479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.217044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 97/195] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/users/57e19f172db149ca9171df3fb54a634d => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:18.221760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.228563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.230412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.253568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.262787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.320318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0e3e-e81b-4036-a576-15f4af85c8ff None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.329159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 99/196] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:18.329974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.358601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.359552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.359829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.360098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.361210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.362709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.364265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 98/197] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:18.369482 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.429927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a75a-a860-4bb6-9070-0575673e4f9d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.453417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.465186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.465830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.466116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.466390 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.467063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:18.467365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.468766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.469462 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f82af-d386-4454-ad62-447cfbe9564c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.476542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 100/198] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:18.477335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.484528 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.504760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.505472 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.505680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.506218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.574340 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.575882 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.579666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe737-bedd-4404-bc9f-28947a5e14e5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.615848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.616487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.616773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.617046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.618233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.619731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.621344 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 101/199] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:18.626754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.684072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.688709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 99/200] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:18.688709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.706422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.732738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139f72-9944-4862-98a0-f38defc8d45c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.770763 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.771386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.771667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.771935 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.772580 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.774125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.794117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfb97-7b92-4451-a977-5cfb1cbbcdb2 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.802676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 102/201] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:18 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:18.803612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.840616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:18.841182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:18.841459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:18.841762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:18.842961 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:18.844501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:18.846354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 100/202] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:18.846966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:18.944408 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:18.965311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb383a10-5425-463d-ba2f-4ebc2fa795b8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.981183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386b53-44c9-4c16-aae7-216906681f75 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:18.992830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:19.002518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.003167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.004223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.004223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.004819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.006319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.007953 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 101/203] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:19.008713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:19.023791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.024443 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.024730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.025003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.025827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=cf8839d7b1a94ebd95252681975150b0) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:19.026141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.027611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.033868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 103/204] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:18 2022] GET /identity/v3/role_assignments?user.id=cf8839d7b1a94ebd95252681975150b0&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:19.034705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:19.144436 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2a3b-4118-45a0-bc69-73454a43260c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:19.184193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663aa0f-b131-4fd5-9522-2dff0d114f1f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:19.189193 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.189889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.190171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.190447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.215576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:19.237294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.239848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.239848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.240021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.240741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b, user.id=57e19f172db149ca9171df3fb54a634d) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:19.241047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.243535 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.253055 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 104/205] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:19 2022] GET /identity/v3/role_assignments?user.id=57e19f172db149ca9171df3fb54a634d&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:19.286229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.288153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.409653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 102/206] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:19.415388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:19.464531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:19.531294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c95df-7ee0-491b-93d3-cd606974e19d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:19.571495 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.572149 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.572434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.572814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.574018 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.575487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfefce-94b8-4009-9e17-88f023959fef None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.577354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 105/207] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:19 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:19.583403 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:19.638859 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:19.693248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237c85-b603-4537-8e42-4968b907a435 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:19.732004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:19.732627 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:19.732907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:19.733178 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:19.733955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] RBAC: Adding query filter params (role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=cf8839d7b1a94ebd95252681975150b0) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:19.734362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:19.735833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb060d2-6dab-4922-9af4-e44e8e0f99d4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:19.745814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 103/208] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:19 2022] GET /identity/v3/role_assignments?user.id=cf8839d7b1a94ebd95252681975150b0&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:21.227472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af232-7d06-4cd6-9ece-64f8a731fb5c None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.228045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af232-7d06-4cd6-9ece-64f8a731fb5c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.228045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af232-7d06-4cd6-9ece-64f8a731fb5c None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.229658 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 106/209] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:21.235829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044997-edfd-41ee-89c0-b2666f0a7d01 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.236476 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044997-edfd-41ee-89c0-b2666f0a7d01 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.236476 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044997-edfd-41ee-89c0-b2666f0a7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.260172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c7044997-edfd-41ee-89c0-b2666f0a7d01 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:21.261397 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c7044997-edfd-41ee-89c0-b2666f0a7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:21.336107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:21.396438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba22ed-8283-460f-a0e8-4fbeeb18c529 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.397063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba22ed-8283-460f-a0e8-4fbeeb18c529 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.397558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba22ed-8283-460f-a0e8-4fbeeb18c529 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.399151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 107/211] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:21.404552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac306-f010-4eba-a9c7-c40aaee9af62 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.405072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac306-f010-4eba-a9c7-c40aaee9af62 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.405564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac306-f010-4eba-a9c7-c40aaee9af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.428037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-647ac306-f010-4eba-a9c7-c40aaee9af62 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:21.429393 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-647ac306-f010-4eba-a9c7-c40aaee9af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:21.471753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:21.500488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:21.511096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a4f-653f-4f63-b057-6d79e4870928 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.511387 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a4f-653f-4f63-b057-6d79e4870928 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.511886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a4f-653f-4f63-b057-6d79e4870928 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.513424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 108/213] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:21.518751 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.519048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.519325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.537651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:21.538844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:21.616414 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 106/214] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:21.686874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4a4f-653f-4f63-b057-6d79e4870928 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:21.795218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4a4f-653f-4f63-b057-6d79e4870928 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:21.803856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:21.833127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:21.833813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.834028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:21.834210 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.834416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.845699 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:21.851483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:21.852391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:21.853183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 109/215] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:21.858650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:21.948471 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ee69-efcd-4581-b1cf-d7d962ef327f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:21.951610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:21.963535 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2119-44d9-4371-a27e-f9bff4c02977 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:21.983895 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:21.984533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.984812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.985086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.994969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:21.996103 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:21.996711 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:21.996983 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:21.997251 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:21.997946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:21.998244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:21.999613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f521-9e9c-45d7-99d7-b455189466e2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:21.999730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:22.000768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:22.001770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.010134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:22.011465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a252245-3378-4539-99d7-1cb0c534aa74 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.011749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a252245-3378-4539-99d7-1cb0c534aa74 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.012019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a252245-3378-4539-99d7-1cb0c534aa74 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.013351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 111/218] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:22.017840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a252245-3378-4539-99d7-1cb0c534aa74 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.046490 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.104115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37f7b-fc47-445d-b9c1-3fd2db5b1cc0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.121000 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a252245-3378-4539-99d7-1cb0c534aa74 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.136900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.137541 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.137853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.138130 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.139232 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.140694 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.142456 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 108/219] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:22.142456 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.158315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.159004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.159287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.159556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.160250 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:22.160551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.161953 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab91219-bccf-48cc-8c3d-1cc84a417a2a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.170641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 112/220] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:22.174680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.175042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.175549 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.175843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.193228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:22.194433 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:22.243271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4d1d-6310-4cd1-8fff-232a6cbef7ed None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.259518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 113/221] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:22.260402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.280475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.281106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.281385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.281674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] PATH_INFO: `/v3/users/45e8a421aae649dabd4537cdb0631380` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.283822 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.296143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a421aae649dabd4537cdb0631380)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.297688 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.299438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 109/222] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/users/45e8a421aae649dabd4537cdb0631380 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:22.300008 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.373060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eaf5f-55cb-47b8-93a5-ffb106dbcfa7 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.403258 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.407743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.408363 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.408640 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.408909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.409583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.411030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.414065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c775e-35a1-4393-ac82-dca83eeb1a59 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.432700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 114/223] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:22 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:22.433347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.454405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.455366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.455366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.455628 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.456894 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.458459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.460945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 110/224] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:22.466963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.552251 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.584696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82c67d-ca55-406c-b673-25263a807b0e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.598066 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf648-f9c7-4eda-94c0-55d68465a6c5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.622265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.623208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.623208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.624172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.639918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.640572 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.640850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.641124 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.642292 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.643762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.646037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 111/225] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:22.646323 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.677841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.704882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.706654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:22.773051 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363ede-07f4-4fbf-b036-1519fb1b69f8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.800181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.819362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.819926 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.820200 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.820477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.834435 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:22.835407 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:22.836333 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:22.840424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:22.841557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 112/227] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:22.842537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:22.947359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439305-d4a3-406c-a03c-d93d1344760a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.952541 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:22.971484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627e6e-876a-4e27-921e-dcc37f27a600 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:22.991563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:22.992281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:22.992564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:22.992839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/users/cf8839d7b1a94ebd95252681975150b0/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:22.994848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, user_id=cf8839d7b1a94ebd95252681975150b0, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:22.997147 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.011344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.012427 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.012994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.013510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.014052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 116/228] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:22 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/users/cf8839d7b1a94ebd95252681975150b0/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:23.014651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:23.015832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.017669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.019769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 113/229] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:22 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:23.029815 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:23.056294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:23.170064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb7a2-7e4e-4da6-8bc3-76fd6f41c51f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:23.212709 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.213598 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.213949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.214323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.215034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:23.215343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.218650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.227304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 117/230] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:23.233776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:23.259928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684f19-6e01-4c9c-abe9-e0fa70f002c1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:23.314050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.314684 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.314968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.315241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.315986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=45e8a421aae649dabd4537cdb0631380) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:23.316296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.321182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.329442 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 114/231] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:23 2022] GET /identity/v3/role_assignments?user.id=45e8a421aae649dabd4537cdb0631380&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:23.370556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:23.375664 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151086-f889-4f65-9b21-43b2da1bcbfa None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:23.415317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.416301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.416758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.417175 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.418672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.420418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.422216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 118/232] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:23 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:23.429775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:23.461956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:23.563637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4538-383d-42fd-9bb8-98aedc0f4179 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:23.613813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.614772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.615059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.615332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.616734 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.618380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da519aa-7804-40ff-8bfa-47bddccfc5cc None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.620493 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 115/233] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:23 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:23.626445 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:23.734071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e437-113a-4a78-9450-0bad2b75325e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:23.770704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:23.771765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:23.772243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:23.772805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/users/cf8839d7b1a94ebd95252681975150b0/roles/c215809d75234d1da0f9b9bd6cc13fb5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:23.775182 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, user_id=cf8839d7b1a94ebd95252681975150b0, role_id=c215809d75234d1da0f9b9bd6cc13fb5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:23.776913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf8cab-94a0-4e25-87c3-3a5d6751d1ec None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:23.793439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:23 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/users/cf8839d7b1a94ebd95252681975150b0/roles/c215809d75234d1da0f9b9bd6cc13fb5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:25.132219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca71b6-2723-46ac-97e2-0ff4845d1695 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.132738 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca71b6-2723-46ac-97e2-0ff4845d1695 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.132813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca71b6-2723-46ac-97e2-0ff4845d1695 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.134437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 116/235] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:25.139761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5efe-93df-4e03-a238-0c59702027ce None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.140184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5efe-93df-4e03-a238-0c59702027ce None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.140351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5efe-93df-4e03-a238-0c59702027ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.165262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-5c9a5efe-93df-4e03-a238-0c59702027ce None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:25.166571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-5c9a5efe-93df-4e03-a238-0c59702027ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:25.201439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:25.267256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:25.593401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6d6f-de52-4ab2-8cf6-e042178c7865 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.594149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6d6f-de52-4ab2-8cf6-e042178c7865 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.594633 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6d6f-de52-4ab2-8cf6-e042178c7865 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.597543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 117/237] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:25.602590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.603112 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.603582 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.629876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:25.631512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:25.687525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ff00-de8e-4d80-a3fc-7f18ca4e8992 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.687836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ff00-de8e-4d80-a3fc-7f18ca4e8992 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.688094 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ff00-de8e-4d80-a3fc-7f18ca4e8992 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.689604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 118/238] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:25.694546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b755-7830-44b0-b921-322b0c08042d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.694889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b755-7830-44b0-b921-322b0c08042d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.695101 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b755-7830-44b0-b921-322b0c08042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.719011 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 121/239] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:25.729370 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d170b755-7830-44b0-b921-322b0c08042d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:25.730615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d170b755-7830-44b0-b921-322b0c08042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:25.801968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 119/240] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:25.853366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:25.960457 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:25.975874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dc590-7dae-4448-b68d-0fb43c101f47 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:25.983200 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4dfa5-5fb8-4270-98d3-21b4ac1dea4c None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.983497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4dfa5-5fb8-4270-98d3-21b4ac1dea4c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.983779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4dfa5-5fb8-4270-98d3-21b4ac1dea4c None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:25.985137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 120/241] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:25.990170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:25.990459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:25.990741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.015475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.017351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.018034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.020137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.025294 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:26.029001 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:26.040823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:26.047194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:26.048096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:26.048901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:26.054621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 122/242] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:26.058979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.061955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.160837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 121/243] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:26.161792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.170460 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa2a8-9e32-40ae-ac87-07647ab5e431 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.219433 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.220332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.221193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.221690 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.222895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:26.223346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.225227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:26.236383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 123/244] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:26.237679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.253046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.298672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544384f-f893-4a64-b299-63e5428b5850 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.347998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.348876 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.349296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.349728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.350969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.352662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:26.354638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:26.355755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.372927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.381036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450fa22-8a89-488f-9074-5ab16c73c7b3 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.427069 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.427900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.428190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.428468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.441951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:26.449201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:26.450154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:26.450949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:26.453755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:26.454743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.474639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875c7a-0b24-48f3-bea6-435582e8a57f None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.515077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.515710 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.515985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.516253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] PATH_INFO: `/v3/users/b3133ff74cd64669ad8df487daddf0cf` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.530151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.530385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] RBAC: Authorizing `identity:get_user(user_id=b3133ff74cd64669ad8df487daddf0cf)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.531843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:26.533991 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 123/247] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/users/b3133ff74cd64669ad8df487daddf0cf => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:26.534899 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.574554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61ae8-2572-4c92-9d52-21e2924e8cf7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.611316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.611959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.612243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.612520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.613192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.614212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.614747 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:26.639244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 125/248] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:26 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:26.639872 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.663493 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511c35-4db5-469c-9ee4-3fc5f06846dd None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.720317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.721754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.722499 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.723014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.724631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:26.725148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.727702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:26.740584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 124/249] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:26.741874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.777987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c653ce-f9ba-4c4d-9970-5c4b2737c99d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.803512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.818540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.820341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.820341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.820341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.836438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:26.843758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:26.844649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:26.845463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 126/250] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:26.846681 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:26.864606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d54fd-f581-42e4-8270-f522c5ea1649 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.907396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:26.908016 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:26.908285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:26.908593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:26.911660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:26.972935 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9013a-82ba-4c86-ad4a-0c8033fa3508 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:26.990955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:26.992447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.018015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.018957 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.019462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.019926 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.021359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.023076 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36f21-b6a6-44e8-bf01-3c1443c2836d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.024843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 127/251] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.026348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42df33-f198-4400-bd48-e36f310c3304 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.026853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42df33-f198-4400-bd48-e36f310c3304 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.027342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42df33-f198-4400-bd48-e36f310c3304 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.028739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 128/252] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:27.029775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42df33-f198-4400-bd48-e36f310c3304 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.095376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.124170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:27.125608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.150797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42df33-f198-4400-bd48-e36f310c3304 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.162168 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.185946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.186587 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.186846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.187124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.187799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:27.188104 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.189664 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e6e2c-b1dd-47a8-b530-b30830fe2db4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.199307 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 129/254] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.200665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.200952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.201227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.219741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:27.221435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:27.236918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c17-322b-4188-9ea4-4ee0452d3298 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.274803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.275762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.276174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.276587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.307428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:27.308408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.361005 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.406674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.408575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.423873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ed1e-345e-49c2-8074-69ead728dc00 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.476132 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.476781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.477056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.477336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.478969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.480588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.482275 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 131/256] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.483044 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.636895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80f3e-d910-4d95-abab-614efcaed97a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.637609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 126/257] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:27.638821 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.659159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.683351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.683994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.684268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.684539 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] PATH_INFO: `/v3/users/45e8a421aae649dabd4537cdb0631380` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.685677 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a421aae649dabd4537cdb0631380)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.687330 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.688891 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 132/258] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/users/45e8a421aae649dabd4537cdb0631380 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.694157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.769390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c022-f2ad-41e2-a569-8362c3ed68ab None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.804361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb652987-6584-43d4-b526-1c040c40b3c8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.805424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.806225 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.806605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.806937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.807676 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=b3133ff74cd64669ad8df487daddf0cf) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:27.807989 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.809466 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.811377 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.822331 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 127/259] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/role_assignments?user.id=b3133ff74cd64669ad8df487daddf0cf&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.823505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.844967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.845917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.846332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.846741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:27.848315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:27.850039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:27.852332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 133/260] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:27.853229 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:27.934276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:27.959551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf80dfe-0106-4c59-9974-26a87ef69a60 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:27.997825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:27.998473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:27.998779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:27.999036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.010707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7985e8-9ff3-4aec-a0a1-c879044de0d1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.016996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:28.030597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:28.031782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:28.032604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 128/261] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:28.033250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.054161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.055163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.055576 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.055982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.057527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.059429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.061425 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 134/262] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:27 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:28.062471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.133775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:28.179119 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de176e1-73b0-4619-b1c2-b00b80c9044c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.180559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c623c-a3da-4a10-8f69-ac24c66d6ba2 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:28.219483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.220103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.220385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.220603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.220744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.221376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=cf8839d7b1a94ebd95252681975150b0) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:28.221639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.221743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.222129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.222545 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.223175 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.223520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:28.223950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.225736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.229343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 129/263] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/role_assignments?user.id=cf8839d7b1a94ebd95252681975150b0&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:28.230138 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.235507 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:28.241037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.354202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4ae74-af04-47f8-85a1-51156a0e9c00 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.389823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.390972 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.391465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.391941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] PATH_INFO: `/v3/users/cf8839d7b1a94ebd95252681975150b0` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.393459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] RBAC: Authorizing `identity:get_user(user_id=cf8839d7b1a94ebd95252681975150b0)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.395173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.396496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba30e2-3f5e-4580-adb8-007c6b689892 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.397639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 136/265] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/users/cf8839d7b1a94ebd95252681975150b0 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:28.402996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.421949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:28.436447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.437571 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.437948 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.438232 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/users/45e8a421aae649dabd4537cdb0631380/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.440388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, user_id=45e8a421aae649dabd4537cdb0631380, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.441934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.458211 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 130/266] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:28 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/users/45e8a421aae649dabd4537cdb0631380/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:28.462481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:28.525240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9329281-7ee7-491a-aa87-a25cb118dd1f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.562889 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.563663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.563946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.564222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.639535 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.641049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.690452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:28.748367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 137/267] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:28.754105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:28.876048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd52738-31d4-4e97-8c14-995968587717 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:28.915355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:28.916020 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:28.916362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:28.916616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:28.917790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:28.919278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e475053-dc3e-48a0-bb42-47c2903664d7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:28.921277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 131/268] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:28.930828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:29.053709 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8ef4-3fe9-497e-aa26-ed07c441f832 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:29.097649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:29.098296 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.098575 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.098846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.099604 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] RBAC: Adding query filter params (role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=cf8839d7b1a94ebd95252681975150b0) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:29.099910 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:29.101443 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d3c0c-33e9-4a94-9e97-6dcd9d30abe3 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:29.108856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 138/269] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:28 2022] GET /identity/v3/role_assignments?user.id=cf8839d7b1a94ebd95252681975150b0&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:29.271559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88ec2-3757-4bdd-8e8c-d384192f22d3 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.272577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88ec2-3757-4bdd-8e8c-d384192f22d3 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.273056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88ec2-3757-4bdd-8e8c-d384192f22d3 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.275202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 132/270] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:29.280602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c032b-17c3-423e-80b9-1b723a8c2ae7 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.281067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c032b-17c3-423e-80b9-1b723a8c2ae7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.281308 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c032b-17c3-423e-80b9-1b723a8c2ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-030c032b-17c3-423e-80b9-1b723a8c2ae7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:29.304995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-030c032b-17c3-423e-80b9-1b723a8c2ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:29.308402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:29.407838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 139/271] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:29.530778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284478a5-27e6-49b5-a6e4-2a02f4e61963 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.531303 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284478a5-27e6-49b5-a6e4-2a02f4e61963 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.531579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284478a5-27e6-49b5-a6e4-2a02f4e61963 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.533091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 133/272] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:29.541657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.541657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.541657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.559501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:29.561014 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:29.633074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 140/273] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:29.742737 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284478a5-27e6-49b5-a6e4-2a02f4e61963 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:29.799397 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:29.853603 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284478a5-27e6-49b5-a6e4-2a02f4e61963 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:29.886230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:29.887121 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:29.887586 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:29.888104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:29.898648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:29.903680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:29.904533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:29.905337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:29.907962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 134/274] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:29.914137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:29.988065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:29.999421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:30.033651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3b497-b326-4ca8-a1a5-0893e3e802a7 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:30.069961 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:30.070952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.071432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.071923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.072854 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:30.073357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:30.075053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:30.084174 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 141/275] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:30.097643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:30.133045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ff-ff8e-472d-a014-60375a8f9eaa None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:30.147698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:30.180249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:30.181284 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.181755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.182497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.183749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:30.185804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:30.188241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 135/276] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:30.193378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:30.197710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e1ea3-5b60-4df8-a5f6-4535a7970c5f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:30.229540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:30.235072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:30.236740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.237259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.238154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] PATH_INFO: `/v3/users/93fb46b104af42e5b649371a3bfa0026` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.256388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] RBAC: Authorizing `identity:get_user(user_id=93fb46b104af42e5b649371a3bfa0026)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:30.258533 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:30.260706 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 142/277] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:30 2022] GET /identity/v3/users/93fb46b104af42e5b649371a3bfa0026 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:30.267520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:30.326315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b172-a3b4-4479-b90f-aed3428dab2e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:30.370028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:30.370642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.370918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.371192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.372251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:30.374057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529b09a-3ec6-48f6-b36a-7044f6161484 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:30.403382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 136/278] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:30 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:30.405358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50ce5-8e4c-4e00-a144-07258ba18a3b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:30.444559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:30.445188 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.445466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.445786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.446517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, user.id=93fb46b104af42e5b649371a3bfa0026, scope.system=all) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:30.446829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:30.448321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c116-2d31-475f-bb54-8ca0576c8477 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:30.454550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 143/279] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Aug 20 20:35:30 2022] GET /identity/v3/role_assignments?user.id=93fb46b104af42e5b649371a3bfa0026&scope.system=all&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:30.711388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaac2a-0056-4773-b0fd-b8defdf1be17 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.712097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaac2a-0056-4773-b0fd-b8defdf1be17 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.712608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaac2a-0056-4773-b0fd-b8defdf1be17 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.714698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 137/280] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:30.720478 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ffad-22ba-476e-afb2-845d66e28196 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:30.721050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ffad-22ba-476e-afb2-845d66e28196 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:30.721526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ffad-22ba-476e-afb2-845d66e28196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:30.740897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-db13ffad-22ba-476e-afb2-845d66e28196 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:30.742448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-db13ffad-22ba-476e-afb2-845d66e28196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:30.800980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:30.823599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 144/281] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:31.147340 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaac2a-0056-4773-b0fd-b8defdf1be17 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.193014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:31.274669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae690-2400-4239-847f-7ba650b83d3d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.274995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae690-2400-4239-847f-7ba650b83d3d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.275221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae690-2400-4239-847f-7ba650b83d3d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.276885 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 145/282] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:31.281917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.282201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.282472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.289933 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaac2a-0056-4773-b0fd-b8defdf1be17 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:31.305189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:31.306512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:31.356345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:31.357087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.357255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.357532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.382495 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:31.387288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:31.388162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:31.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:31.398140 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 138/283] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:31.399817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 146/284] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:31.405766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.550390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:31.557717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78425d9c-90dd-47bf-93d4-b684edfa8565 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:31.607830 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:31.608446 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.608721 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.608988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.609672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:31.609978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:31.611379 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:31.620229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 139/285] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:31.627151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.719671 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.755004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fdd25-eeff-426c-9c02-961c860a9837 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:31.770625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:31.793714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:31.794629 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.795085 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.795501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] PATH_INFO: `/v3/users/b3133ff74cd64669ad8df487daddf0cf` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.796934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] RBAC: Authorizing `identity:get_user(user_id=b3133ff74cd64669ad8df487daddf0cf)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:31.798830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:31.801087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 147/286] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/users/b3133ff74cd64669ad8df487daddf0cf => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:31.806897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.877163 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e823bd-965c-4c87-ab71-3506d821b395 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:31.919243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:31.919889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:31.920165 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:31.920437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:31.948158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:31.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:31.954349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:31.955136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 140/287] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:31.975067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:31.991257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6acbf0-27ff-49ce-9563-f8efebb5399d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:31.998046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:32.058927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:32.061110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:32.061928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:32.063978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:32.065971 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:32.071924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:32.074547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 148/288] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:32.081377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:32.153762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05b681-6a21-4a0b-b870-203a4542bd13 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:32.179325 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:32.212893 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:32.213849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:32.213849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:32.214185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:32.214864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:32.215172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:32.216747 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:32.233785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 141/289] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:32.239338 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:32.241488 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f2f0-624b-4bd6-a77e-fb983fd5bb62 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:32.279455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:32.280485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:32.280987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:32.281496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/users/b3133ff74cd64669ad8df487daddf0cf/roles/892631c0d62d4759bcb78c7dfd53e451` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:32.283792 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, user_id=b3133ff74cd64669ad8df487daddf0cf, role_id=892631c0d62d4759bcb78c7dfd53e451)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:32.285564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:32.301769 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 149/290] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:35:32 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/users/b3133ff74cd64669ad8df487daddf0cf/roles/892631c0d62d4759bcb78c7dfd53e451 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:35:32.404501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:32.432912 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45dfa-3917-4b2f-bb65-c04f3c1800d7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:32.472787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:32.473440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:32.473757 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:32.474094 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] PATH_INFO: `/v3/users/45e8a421aae649dabd4537cdb0631380` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:32.475244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a421aae649dabd4537cdb0631380)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:32.476834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:32.483110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 142/291] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:32 2022] GET /identity/v3/users/45e8a421aae649dabd4537cdb0631380 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:32.486820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:32.620399 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04504f-710f-4158-825a-d61e431f9d45 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:32.633016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:32.664066 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:32.665129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:32.665611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:32.666140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:32.738562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:32.740383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:32.855627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 150/292] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:32.862091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:33.017105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a4d8-d489-474e-be4f-c2dec71aca26 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:33.061031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:33.061702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.061983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.062257 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.063385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:33.064853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d535da8-62a3-402c-a4dc-de0bfd78a7e4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:33.067883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 143/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:32 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:33.073092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:33.097647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:33.117780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178121-ce6f-4ef7-b458-c55587453f30 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.117780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178121-ce6f-4ef7-b458-c55587453f30 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.117780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178121-ce6f-4ef7-b458-c55587453f30 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.117780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 144/294] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:33.122641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349e31-3da0-446b-98b9-03eeeaa1bd0a None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.122933 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349e31-3da0-446b-98b9-03eeeaa1bd0a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.123215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349e31-3da0-446b-98b9-03eeeaa1bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.141391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a3349e31-3da0-446b-98b9-03eeeaa1bd0a None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:33.142655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a3349e31-3da0-446b-98b9-03eeeaa1bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:33.153405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:33.243508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13fcbb-3681-497e-8248-712062cedad1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:33.251569 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 145/295] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:33.284108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:33.284953 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.285397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.285846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.286738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=45e8a421aae649dabd4537cdb0631380) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:33.287193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:33.288779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160b07-ee97-421e-b0ea-e2132a7ccd75 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:33.295223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 151/296] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:33 2022] GET /identity/v3/role_assignments?user.id=45e8a421aae649dabd4537cdb0631380&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:33.389134 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8a7a-60a4-40d2-aa1f-5567bdaaa46e None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.389876 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8a7a-60a4-40d2-aa1f-5567bdaaa46e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.390352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8a7a-60a4-40d2-aa1f-5567bdaaa46e None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.392240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 146/297] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:33.398392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.399023 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.399496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.406785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6b20-2052-49b4-b740-c444c6888ed0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.407732 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6b20-2052-49b4-b740-c444c6888ed0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.408227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6b20-2052-49b4-b740-c444c6888ed0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.409861 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 147/298] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:33.415602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.416228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.416699 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.424110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:33.425556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:33.443274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:33.444639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:33.497681 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:33.545378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:33.674821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:33.683789 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:33.794887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dd00d-66cf-43cc-8923-4b61872f9f36 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:33.839608 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:33.840235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:33.840523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:33.840797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:33.852600 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:33.857450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:33.858349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:33.859557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 153/301] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:33.865891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:33.912500 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:33.966245 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:33.976907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:33.992667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef8cf-55ee-41ec-99bc-9884bdd697b2 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.018501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d65e02-008f-47c6-8bf2-3b6c9608328a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.025823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.026609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.026888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.027167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.027821 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:34.028119 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.029502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.043047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 149/302] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.043047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.052609 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.053251 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.053526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.053828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.063988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:34.069177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:34.070284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:34.071089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 154/303] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:34.071736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.156962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca603b9-b004-49e7-bd72-6dd0212af12d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.179644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a62e-459e-4b95-8c0a-7b3109aa5d06 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.192299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.192973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.193255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.193530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.194692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.196152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.197829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 150/304] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.201789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.204205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:34.209191 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:34.221519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.222281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.222559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.222830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] PATH_INFO: `/v3/users/93fb46b104af42e5b649371a3bfa0026` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.224349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] RBAC: Authorizing `identity:get_user(user_id=93fb46b104af42e5b649371a3bfa0026)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.225978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.232065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 155/305] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:34 2022] GET /identity/v3/users/93fb46b104af42e5b649371a3bfa0026 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.232065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.315896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cf85e-1ce0-4c28-a9f4-05992bfde4ee None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.341222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4dccb-d6fb-409c-9ed7-2ed2526a042d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.350275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.350905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.351188 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.351454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.352143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:34.352449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.354004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.367413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 151/306] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.367413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.379603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.380631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.380916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.381190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] PATH_INFO: `/v3/groups` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.381855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.383318 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.403100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 156/307] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Aug 20 20:35:34 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:34.403927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.453593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:34.479845 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:34.512844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c73d9-237f-4d21-a0a3-6f005ce0ac5c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.549184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf5ba-b4ac-47a9-85fb-f10d79d4fe91 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.551833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.553349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.553349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.553349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] PATH_INFO: `/v3/system/users/93fb46b104af42e5b649371a3bfa0026/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.554922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93fb46b104af42e5b649371a3bfa0026, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.556440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.573696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 152/308] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Aug 20 20:35:34 2022] PUT /identity/v3/system/users/93fb46b104af42e5b649371a3bfa0026/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:34.604786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.605575 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.605892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.606169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] PATH_INFO: `/v3/users/953c39de112548f48b5203a77a5b2995` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.622060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] RBAC: Authorizing `identity:get_user(user_id=953c39de112548f48b5203a77a5b2995)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.623721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bfd88-88d2-4600-9898-e202e7c9d1de None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.625787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:34 2022] GET /identity/v3/users/953c39de112548f48b5203a77a5b2995 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.631904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:34.748774 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616165-b0d1-4f4f-a14a-d30e58897e37 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:34.785526 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:34.792207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:34.793115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.793983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.794231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.796235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, user.id=953c39de112548f48b5203a77a5b2995, scope.system=all) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:34.796235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:34.796731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca341a-7843-4a3f-b44c-f198e74b374e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:34.805650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 153/310] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Aug 20 20:35:34 2022] GET /identity/v3/role_assignments?user.id=953c39de112548f48b5203a77a5b2995&scope.system=all&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:34.924120 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab542a-755e-44a2-bdf2-0ed76c92e404 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.924641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab542a-755e-44a2-bdf2-0ed76c92e404 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.924712 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab542a-755e-44a2-bdf2-0ed76c92e404 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.926355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 158/311] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:34.932206 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:34.932515 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:34.932767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:34.952344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:34.953570 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:35.026410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:35.349865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab542a-755e-44a2-bdf2-0ed76c92e404 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:35.456702 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab542a-755e-44a2-bdf2-0ed76c92e404 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:35.468403 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:35.492141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:35.492784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:35.493062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:35.493337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:35.503834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:35.508641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:35.509526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:35.510964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:35.515655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:35.614932 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554b22d-43e7-4fdb-938d-d7f6fa1d37a9 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:35.644686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:35.650800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:35.651480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:35.651857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:35.652128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:35.652799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:35.653097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:35.654608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:35.664138 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:35.669590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:35.770861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a9b4-bc4c-48f2-a6d2-63ba735ac923 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:35.809573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:35.810226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:35.810511 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:35.810776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] PATH_INFO: `/v3/users/b3133ff74cd64669ad8df487daddf0cf` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:35.811898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] RBAC: Authorizing `identity:get_user(user_id=b3133ff74cd64669ad8df487daddf0cf)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:35.813357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:35.814934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:35 2022] GET /identity/v3/users/b3133ff74cd64669ad8df487daddf0cf => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:35.820529 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:35.931392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b312b6-9986-49f2-bd24-3f9c461f7c3b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:35.966741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:35.967383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:35.967659 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:35.967928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.021747 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:36.035310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:36.036951 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:36.134587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:35:36.140199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:36.180330 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:36.240324 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84c91-ae55-424b-9769-d9fc707bac38 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:36.274038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:36.274682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.274956 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.275225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.276410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:36.277982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6e781-51c8-4c04-9fc5-89a7adc56967 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:36.279903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:36 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:36.288341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:36.388765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:36.400943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df980892-d4b7-4eaa-ba82-7f4bb639e503 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:36.437128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:36.437773 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.438052 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.438321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.439080 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, scope.project.id=588c912248cd46cf825987e3b8af748c, user.id=b3133ff74cd64669ad8df487daddf0cf) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:36.439347 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:36.440803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd744-a45e-4623-a079-2fa3e4f57c75 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:36.447494 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:35:36 2022] GET /identity/v3/role_assignments?user.id=b3133ff74cd64669ad8df487daddf0cf&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:36.762110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e566-ec5e-45c1-b8b4-709beb5ae3b1 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.762396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e566-ec5e-45c1-b8b4-709beb5ae3b1 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.762674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e566-ec5e-45c1-b8b4-709beb5ae3b1 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.764037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 162/319] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:36.769744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb69-e816-425a-bcee-40081d4ddadd None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.770198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb69-e816-425a-bcee-40081d4ddadd None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.770359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb69-e816-425a-bcee-40081d4ddadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.788807 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-dd19eb69-e816-425a-bcee-40081d4ddadd None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:36.790042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-dd19eb69-e816-425a-bcee-40081d4ddadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:36.867053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2bfc-4263-4b35-9669-fd2167371606 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.867328 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2bfc-4263-4b35-9669-fd2167371606 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.867603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2bfc-4263-4b35-9669-fd2167371606 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.869131 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 163/320] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:36.877142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 158/321] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:36.877269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f693b-a1e2-4f61-a417-d4ab823f845d None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:36.877269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f693b-a1e2-4f61-a417-d4ab823f845d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:36.877269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f693b-a1e2-4f61-a417-d4ab823f845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:36.892875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-686f693b-a1e2-4f61-a417-d4ab823f845d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:36.894287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-686f693b-a1e2-4f61-a417-d4ab823f845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:36.968019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 164/322] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:37.093574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8067e-a404-45ad-be8d-a23e2f053d45 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.093837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8067e-a404-45ad-be8d-a23e2f053d45 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.094244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8067e-a404-45ad-be8d-a23e2f053d45 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.095702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 159/323] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:37.100974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.101257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.101528 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.120219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:37.121414 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:37.151192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.190678 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 165/324] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:37.191701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8067e-a404-45ad-be8d-a23e2f053d45 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.276031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.293928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.296947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8067e-a404-45ad-be8d-a23e2f053d45 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.342082 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.343040 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.343325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.343923 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.345141 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.347283 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.349524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 160/325] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:37.355321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.401420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665fb7f-81ab-427d-9331-b6b72b85f464 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.437696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.438345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.438691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.438909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.452062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:37.456833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:37.457766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:37.458589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 166/326] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:37.464028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.468622 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a5d9-4501-49ad-b5f3-b2f6ceee5890 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.491898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.506500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.507183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.507464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.507732 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] PATH_INFO: `/v3/groups` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.508349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.510278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.526158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 161/327] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Aug 20 20:35:37 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:37.526952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.547123 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.576524 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b96b9-3708-439a-8b6c-daf880c5305c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.616973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.617567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.617869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.618143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.618872 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:37.619175 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.620701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.630786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 167/328] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:37.636447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.654051 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9e15a-2cd7-4d0a-847b-9540e67fc063 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.689850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.690503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.690782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.691058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.702375 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:37.708429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:37.709546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:37.710964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 162/329] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:37.715077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.737787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.754637 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280e2-877c-49be-9d9a-1556e50ebd0a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.792972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:37.800238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.800892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.801173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.801451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] PATH_INFO: `/v3/users/93fb46b104af42e5b649371a3bfa0026` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.802823 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=93fb46b104af42e5b649371a3bfa0026)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.804372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.806195 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 168/330] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/users/93fb46b104af42e5b649371a3bfa0026 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:37.812139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.837978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8574-47ba-4fac-a305-657db06594c6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.881917 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.883145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.883145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.883145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.883657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:37.884249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.885949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.901125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 163/331] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:37.906273 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:37.941375 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7da88-f3d9-4a87-b0fd-ba78b2e76bd9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:37.979669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:37.980073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:37.980362 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:37.980646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:37.981870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] RBAC: Adding query filter params (role.id=becf529cca0348e1a6ed9bd74200b731, user.id=93fb46b104af42e5b649371a3bfa0026, scope.system=all) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:37.981870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:37.984252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:37.997693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 169/332] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/role_assignments?user.id=93fb46b104af42e5b649371a3bfa0026&scope.system=all&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:38.027385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45b39-b634-4561-ac47-9c05d4598155 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:38.059643 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:38.068931 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:38.069601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:38.069907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:38.070177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] PATH_INFO: `/v3/users/953c39de112548f48b5203a77a5b2995` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:38.071482 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] RBAC: Authorizing `identity:get_user(user_id=953c39de112548f48b5203a77a5b2995)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:38.073148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52154d86-4a8a-49b7-be43-8e397ea29961 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:38.075252 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 164/333] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:37 2022] GET /identity/v3/users/953c39de112548f48b5203a77a5b2995 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:38.081151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:38.100810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:38.193848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f290-9a31-43d9-a677-d21feb2fa9be None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:38.237546 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:38.238238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:38.238515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:38.238785 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] PATH_INFO: `/v3/system/users/953c39de112548f48b5203a77a5b2995/roles/892631c0d62d4759bcb78c7dfd53e451` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:38.240186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=953c39de112548f48b5203a77a5b2995, role_id=892631c0d62d4759bcb78c7dfd53e451)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:38.241572 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a90b9e-a08d-44df-b74a-b68749968f1a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:38.252581 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 170/334] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Aug 20 20:35:38 2022] PUT /identity/v3/system/users/953c39de112548f48b5203a77a5b2995/roles/892631c0d62d4759bcb78c7dfd53e451 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:40.212405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ca986-c319-497f-92f7-a48698c7aa28 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.213011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ca986-c319-497f-92f7-a48698c7aa28 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.213011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ca986-c319-497f-92f7-a48698c7aa28 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.214668 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 165/335] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:40.221589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931813-5c50-4e1b-8982-4b20fe2a395e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.222073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931813-5c50-4e1b-8982-4b20fe2a395e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.222266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931813-5c50-4e1b-8982-4b20fe2a395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.244645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-48931813-5c50-4e1b-8982-4b20fe2a395e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:40.245871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-48931813-5c50-4e1b-8982-4b20fe2a395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:40.337156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:40.621296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc347-6fef-4c9b-b02e-195802bcb23b None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.621605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc347-6fef-4c9b-b02e-195802bcb23b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.621813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdc347-6fef-4c9b-b02e-195802bcb23b None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.623477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 166/337] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:40.628559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288590dc-a3f6-4aab-ba37-1884693876e3 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.628855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288590dc-a3f6-4aab-ba37-1884693876e3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.629137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288590dc-a3f6-4aab-ba37-1884693876e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.650231 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-288590dc-a3f6-4aab-ba37-1884693876e3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:40.651496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-288590dc-a3f6-4aab-ba37-1884693876e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:40.653508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:40.740795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:40.771942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465c7e-36d6-432c-a340-4fd9a9ca19a3 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.772255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465c7e-36d6-432c-a340-4fd9a9ca19a3 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.772512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc465c7e-36d6-432c-a340-4fd9a9ca19a3 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.774890 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 167/339] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:40.780949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:40.781243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:40.781521 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:40.806624 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:40.807899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:40.887008 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 173/340] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:40.899384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465c7e-36d6-432c-a340-4fd9a9ca19a3 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.016255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc465c7e-36d6-432c-a340-4fd9a9ca19a3 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.060158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.060806 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.061088 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.061394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.073764 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:41.079098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:41.080005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:41.080823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 168/341] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:41.086465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.180897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.217895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435be39-d3d8-4973-8efa-3eddbb2e5c85 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.225151 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.269739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.271842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.272125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.272392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.273067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:41.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:41.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:41.299502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 174/342] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:41.304180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.334642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.395969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e566-e29a-4833-874d-318e801306c5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.433873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.434436 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.435068 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.435351 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.446633 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:41.451996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:41.453058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:41.454087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 169/343] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:41.459173 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.536785 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c566c8-9a11-4ee0-8636-69f8f52e244d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.571172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848446-a9c3-4051-a746-97ab67a97959 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.594826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.597181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.610739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.611080 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.611404 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.611683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.611790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.611947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.612043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.612277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.612998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:41.613302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:41.614753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:41.624788 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 170/344] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:41.625650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.702760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:41.704350 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5db1d-a524-49e8-9e4b-be12b5886f3d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:41.754092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015b56-b049-41b1-8e00-a99cc7c3f459 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.807768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:41.808423 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.808694 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.808962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.823720 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:41.825322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 175/345] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:41.826772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c1dd-9161-4e5e-ba9e-3184e495551e None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:41.827064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c1dd-9161-4e5e-ba9e-3184e495551e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:41.827337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c1dd-9161-4e5e-ba9e-3184e495551e None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:41.828888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:41.829776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:41.830602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 171/347] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:41.831726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.832885 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 176/347] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:41.833767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c1dd-9161-4e5e-ba9e-3184e495551e None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:41.881960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.887230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:41.969805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ecbf-110f-40f2-9edf-ce0c40fffb00 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:41.985645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c1dd-9161-4e5e-ba9e-3184e495551e None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.015589 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.016212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.016480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.016746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.033170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.034253 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.034540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.034821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.036579 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.038397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc037-eec3-4bf0-9a2d-2c157b12e493 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.040971 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 177/348] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:42.043130 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.043418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.043692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.067429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:42.068687 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:42.102884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.104597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.160366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.172989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 178/349] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:42.174436 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.205239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.239760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 172/350] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:42.240447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.288522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e21a91-7757-4d06-873d-a0ec232064b0 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.329652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.329652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.329652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.329652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.330071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:42.330071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.330071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5f6-b2f4-4760-82f7-a32b6e48bef7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.338860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 179/351] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:42.340366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7551a-f48c-4d9a-b1f9-391becd72ca4 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.340858 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7551a-f48c-4d9a-b1f9-391becd72ca4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.341338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7551a-f48c-4d9a-b1f9-391becd72ca4 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.342739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 180/352] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:42.349570 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7551a-f48c-4d9a-b1f9-391becd72ca4 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.365666 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef137-f5d7-4b6b-b8d5-c44b092ebcea None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.403516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.404641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.405065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.405342 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.413143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.415103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d702-1d72-43b1-8ef4-9b511b545741 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.416780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 173/353] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:42.418418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.418707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.418993 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.427200 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.444271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:42.445527 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:42.475186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.488382 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7551a-f48c-4d9a-b1f9-391becd72ca4 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.531592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.532165 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.532448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.532726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.534697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 174/354] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:42.535794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.536473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.541343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 181/355] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:42.541343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.669157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a966f7-abb7-4cd7-af96-72fc0e2d0300 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.672137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91733c-76dd-4360-8b3d-7979be5c214f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.714376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.715145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.715431 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.715708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.716452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:42.716763 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.718694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.720502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.721337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.721797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.722223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.726585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.727870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 182/356] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:42.729893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.774072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:42.822330 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:42.824145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29bca-4cbf-4ae7-a149-2e372bf26281 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:42.871882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea11ab-9bb9-4af6-b4ff-5c4cbe080a59 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:42.926929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:42.927601 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.927878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.928148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.942499 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:42.949291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:42.950248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 20 20:35:42.951046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:42.953048 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 183/357] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:42.954117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:42.969565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 175/358] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:42.970845 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171030-0081-4bc0-b128-7d277b296435 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:42.971150 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171030-0081-4bc0-b128-7d277b296435 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:42.971452 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171030-0081-4bc0-b128-7d277b296435 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:42.972713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 176/359] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:42.973532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171030-0081-4bc0-b128-7d277b296435 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.024390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.060424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.087073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86338-3b5e-4bf9-b88a-624563d6bd77 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.101766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171030-0081-4bc0-b128-7d277b296435 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.136080 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.136875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.137172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.137437 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.138607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.140074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.141679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 184/360] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.142529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.144264 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.146036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.146036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.146036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.161264 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:43.167106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:43.168022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:43.168848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 177/361] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:43.170454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.285050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6190-c4a3-4958-a676-698ba8f2e624 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.292319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.299896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14ab83-d754-4a99-9cd9-39a7b50a4655 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.337294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.338654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.339143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.339656 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.340527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:43.341058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.343941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.345849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.346497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.346772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.347048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.348281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.349843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee087-a1b0-4d2c-a25d-faf88e0da554 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.351479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 178/362] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.351965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 185/363] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.352716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.352959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.353060 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.353318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.371650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:43.372834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:43.377383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.452308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 179/364] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:43.457804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.485261 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae27ce-3349-4643-bc23-80f72c4cefc2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.521830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.522447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.522721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.523013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.523770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:43.524081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.525822 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.532311 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 186/365] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.533249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.579131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.591331 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503b47d-3ec4-4ab4-be12-c1cf3203e14b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.627611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.634186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.634826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.635158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.635430 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.636357 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:43.636661 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.638388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.647667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 180/366] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.648608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.655135 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd654-841c-4408-abdc-00d73c06595d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.693869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.694957 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.695440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.695933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.697469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.699398 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.701272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 187/367] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.702448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.769928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32338f-f362-4445-9065-130f4e94f2df None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.811108 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.811807 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.812267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.812382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] PATH_INFO: `/v3/users/953c39de112548f48b5203a77a5b2995` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.813509 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] RBAC: Authorizing `identity:get_user(user_id=953c39de112548f48b5203a77a5b2995)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.815089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.815784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f021c94-d91d-468b-896e-8fd660d5c33e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:43.816965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 181/368] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/users/953c39de112548f48b5203a77a5b2995 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:43.817558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:43.861100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:43.862147 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:43.862643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:43.863228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:43.864748 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.883160 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:43.947563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:43.949418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:43.986858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfdfa-893b-4fe7-8fc5-26c6d04718cb None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.042032 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.043299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.043299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.043299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.043958 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=588c912248cd46cf825987e3b8af748c) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:44.044264 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.045814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.053890 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 182/369] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:44.054855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.061919 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 188/370] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:44.063176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.143421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:44.180334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:44.220248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69010b-4e35-4a3b-a193-80dfaebb36c4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.241476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350aadf-ce46-4bc9-a58f-f102bb29a1d8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.268616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.269287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.269576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.269876 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.270711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] RBAC: Adding query filter params (role.id=892631c0d62d4759bcb78c7dfd53e451, user.id=953c39de112548f48b5203a77a5b2995, scope.system=all) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:44.271030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.272599 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.285194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.286264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.286735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.287207 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.298268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 183/371] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/role_assignments?user.id=953c39de112548f48b5203a77a5b2995&scope.system=all&role.id=892631c0d62d4759bcb78c7dfd53e451 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:44.299845 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.322365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:44.333647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:44.334619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:44.335731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 189/372] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:44.342725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.475852 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812642d-542e-4621-9c66-403e70b739b0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.506379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498ff3-b1b2-43b3-a7b8-30f1f5b01012 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.518027 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:44.546480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.547158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.547438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.547716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.548988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.550513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.552485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 184/373] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:44.570715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.581382 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.582066 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.582347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.582619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.583328 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:44.583704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.585121 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.600227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 190/374] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:44.605949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.606144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:44.745581 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8fab-a58b-436b-a84b-fd8c37fe0b01 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.761181 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be754d-69e4-4e06-b2d2-f9dd9367852e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:44.800775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.801810 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:44.802670 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.803517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:44.803983 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.804443 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:44.804895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.805346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:44.807464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.809371 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.812973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 185/375] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:44.820781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:44.874564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:44.940965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:44.943434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:44.981980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:45.021792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85911-3504-4b9b-b3aa-de5a3b4c6581 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:45.090263 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:45.090881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.091156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.091426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.092238 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=588c912248cd46cf825987e3b8af748c) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:45.092543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:45.094035 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:45.109333 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 186/376] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:45.126456 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 191/377] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:35:45.132005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:45.246143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9330-3dc4-45d2-9716-8245082a2082 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:45.286391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:45.286964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.287242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.287512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] PATH_INFO: `/v3/projects/caafa8b40709435db0e905664e3dcd9f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.288691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] RBAC: Authorizing `identity:get_project(project_id=caafa8b40709435db0e905664e3dcd9f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:45.292580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:45.294658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 187/378] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:45 2022] GET /identity/v3/projects/caafa8b40709435db0e905664e3dcd9f => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:45.299884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:45.380161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:45.419600 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2eb2-c1c3-4854-998c-75b4eb14ae67 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:45.456049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:45.456703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.456982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.457256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] PATH_INFO: `/v3/groups/c620dc96a9054f21985322e376c07499` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.464372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] RBAC: Authorizing `identity:get_group(group_id=c620dc96a9054f21985322e376c07499)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:45.465866 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7f08c-8346-44a0-a64a-bd727f8fe03b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:45.467851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 192/379] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:45 2022] GET /identity/v3/groups/c620dc96a9054f21985322e376c07499 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:45.473477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:45.492989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559d1b-ac4c-4f3c-ab86-aa5b7c59e3bd None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.493315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559d1b-ac4c-4f3c-ab86-aa5b7c59e3bd None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.493537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559d1b-ac4c-4f3c-ab86-aa5b7c59e3bd None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.495340 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 193/380] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:45.500322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.500600 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.500874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.501253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:45.520001 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:45.521184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:45.627622 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b1b5-a1b2-4d25-a2eb-aee416b911e0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:45.636385 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 194/381] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:45.664177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:45.664809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:45.665087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:45.665352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:45.666165 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] RBAC: Adding query filter params (group.id=c620dc96a9054f21985322e376c07499, role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=caafa8b40709435db0e905664e3dcd9f) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:45.666497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:45.667984 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:45.674682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 188/382] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:45 2022] GET /identity/v3/role_assignments?group.id=c620dc96a9054f21985322e376c07499&scope.project.id=caafa8b40709435db0e905664e3dcd9f&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:46.017601 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:46.082898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:46.137082 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42188b84-41c6-42b4-955d-32e3f482a3df None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:46.183566 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:46.184215 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:46.184522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:46.184754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:46.200087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:46.204814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:46.205826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:46.206631 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 195/383] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:46.212231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:46.342092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:46.368288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164f679-2945-4f0b-bf15-c4277f136b52 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:46.415625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:46.416304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:46.416585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:46.416859 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:46.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] RBAC: Adding query filter params (name=member) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:46.417851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:46.419244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:46.428356 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 189/384] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:46.433968 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:46.607786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a719fd-1f6a-4e17-8aaa-741309404afa None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:46.630918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:46.650567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:46.651223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:46.651504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:46.651778 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:46.652922 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:46.654467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:46.656424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 196/385] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:46 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:46.661781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:46.779179 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18272e-d100-4a1f-b421-117fcdf0da0f None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:46.819760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:46.820406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:46.820690 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:46.820967 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:46.822146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:46.823682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584df79-5e36-4de5-a571-67da9e33ed7e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:46.825401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 190/386] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:46 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:46.831353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:46.960859 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2754fe-e32f-4151-a4a8-79e8e40b1855 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:46.997487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:46.998194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:46.998474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:46.998750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/groups/14f2c0165955450fb08f61ace4c8088f/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.000700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, group_id=14f2c0165955450fb08f61ace4c8088f, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:47.002209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d851c1d-d46a-47e5-8eb4-ad762ec369dc None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:47.019951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 197/387] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Aug 20 20:35:46 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/groups/14f2c0165955450fb08f61ace4c8088f/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:47.024663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398300-b761-4438-8bb7-92eb610b00d0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.025043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398300-b761-4438-8bb7-92eb610b00d0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.025411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398300-b761-4438-8bb7-92eb610b00d0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.027488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 191/388] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:35:47.039574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.039963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.040250 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.045828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f2d0-ac00-4246-9572-91ffc79b2c0b None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.046143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f2d0-ac00-4246-9572-91ffc79b2c0b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.046386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f2d0-ac00-4246-9572-91ffc79b2c0b None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.047984 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 192/389] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:47.053842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.054150 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.054385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.069386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:47.070614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:47.076501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:47.089388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:47.090735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:47.146691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:47.188047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 198/390] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:47.201195 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 193/391] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:47.584138 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:47.640023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:47.700087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e1577-d8ca-41c7-b82b-f6de9727b680 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:47.741410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:47.742092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.742374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.742648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.754838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:47.760964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:47.761909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:47.762731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 199/392] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:47.771554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:47.798174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d238-371f-44c4-bd20-20d04b58a9d7 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:47.832557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:47.833197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:47.833531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:47.834452 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:47.837225 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:47.849184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:47.863625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:47.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:47.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:47.873170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:47.874306 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 194/393] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:47.881103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:47.950526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eca69-822c-4d73-8f72-d0bfbd94a30d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.015050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.015885 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.016170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.016442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.019529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:48.019849 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.021285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.042025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 200/394] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:48.046592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.076447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b2679-68e6-4e5c-83de-b5c729be8c3a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.143335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.143877 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.144156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.144482 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.145208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:48.145564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.147000 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.164581 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 195/395] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:48.170753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.232319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:48.236290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46d2c1-ad5d-4536-833d-a98162e36fc9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.257885 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:48.276933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.277748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.278126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.278514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.279737 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.281428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2433-d3e1-48ee-834e-e6fba6a7623b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.283285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 201/396] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:48 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:48.287995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437dbb-bd85-4ad4-a959-0e0c12b8ca35 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.287995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437dbb-bd85-4ad4-a959-0e0c12b8ca35 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.287995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437dbb-bd85-4ad4-a959-0e0c12b8ca35 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.287995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 202/397] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:48.288940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437dbb-bd85-4ad4-a959-0e0c12b8ca35 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.325161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247379-7c95-45b4-aa15-b541ec3778ec None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.371324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.371978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.372261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.372539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.373957 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.376118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b47c5-6860-495b-ae6b-125bbc683c15 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.382005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 196/398] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:48 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:48.382005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.382005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.382005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.402594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:48.403978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:48.421264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437dbb-bd85-4ad4-a959-0e0c12b8ca35 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.465098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.466140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.466140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.466320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.467570 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.469091 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.471288 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 203/399] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:48 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:48.472233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.496562 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 197/400] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:48.497305 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.521821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:48.555881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:48.606172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e933a1-ca7c-4b4d-9086-57be53e6a888 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.643670 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.644749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.645353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.645811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.647357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.649290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.651447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 204/401] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:48 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:48.653439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545fa7e-8896-4a8d-831d-3f92ceba82a5 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.661905 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:48.696650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.697463 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.697793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.698077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/groups/14f2c0165955450fb08f61ace4c8088f/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.700205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, group_id=14f2c0165955450fb08f61ace4c8088f, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.701693 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dccae-dbed-4fc3-9cb9-1f4353d5f967 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.717772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 198/402] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Aug 20 20:35:48 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/groups/14f2c0165955450fb08f61ace4c8088f/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:48.719205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7662-87ba-4a17-a540-e5deee5106d0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.719469 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7662-87ba-4a17-a540-e5deee5106d0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.719837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7662-87ba-4a17-a540-e5deee5106d0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.721419 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 199/403] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:48.727029 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.727536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.727950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.747720 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:48.749074 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:48.786831 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a415e-748f-427d-8610-23fccb7680cc None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:48.789697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:48.832778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 200/404] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:48.870458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:48.871158 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:48.871442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:48.871714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/groups/14f2c0165955450fb08f61ace4c8088f/roles/c215809d75234d1da0f9b9bd6cc13fb5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:48.873899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] RBAC: Authorizing `identity:create_grant(project_id=b111b020c0524a4fb7ab59a64c9c381b, group_id=14f2c0165955450fb08f61ace4c8088f, role_id=c215809d75234d1da0f9b9bd6cc13fb5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:48.875442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:48.905929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 205/405] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Aug 20 20:35:48 2022] PUT /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b/groups/14f2c0165955450fb08f61ace4c8088f/roles/c215809d75234d1da0f9b9bd6cc13fb5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:49.023413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.075945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.138963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551c5e3-022d-4609-84b4-d3674c1e921b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.177958 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.178518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.178798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.179073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.190873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:49.195762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:49.196640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:49.197484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 201/406] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:49.203197 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.223709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.366064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576982ae-15e2-41d5-89b9-30df00eafc5a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.397117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c545bae-2d7b-4962-9b0b-e6485924fd89 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.417095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.437290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.437968 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.438248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.438522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.439210 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:49.439518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.444886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.463178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 206/407] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:49.465897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.469144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.470110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.470621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.471115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.486792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:49.492069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:49.492960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:49.493791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:49.503012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.504975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 202/408] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:49.515717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.582785 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa7273-a328-4de6-a548-78ddd2330719 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.616531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.617190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.617433 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.617738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.618849 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.620347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f726f3e-dd9e-4c56-8c1c-c53a77d242b7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.622106 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 207/409] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:49.623063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180510-203f-4f46-bdb0-9252bdeaaa82 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.623346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180510-203f-4f46-bdb0-9252bdeaaa82 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.623614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180510-203f-4f46-bdb0-9252bdeaaa82 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.624778 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 208/410] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:49.629653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180510-203f-4f46-bdb0-9252bdeaaa82 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.649301 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa00fd-05a2-41b0-884d-508cf76fb470 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.683711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.684328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.684609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.684883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.685546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:49.685881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.687286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507edad-d415-4816-b955-862d5ffacefb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.700842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 203/411] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:49.702164 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.705926 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.705926 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.721359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:49.722672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:49.751245 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.753185 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.763062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180510-203f-4f46-bdb0-9252bdeaaa82 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.795890 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 204/412] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:49.796839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.799301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.800230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.800647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.801056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.802334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.803925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.805819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 209/413] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:49.811745 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.897552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb954-18a4-4486-b9c7-f691a56b9313 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.920467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a188d-113f-42f2-ab3b-d3ba699dc31a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:49.931834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.932290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.932575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.932847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] PATH_INFO: `/v3/groups/c620dc96a9054f21985322e376c07499` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.934037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] RBAC: Authorizing `identity:get_group(group_id=c620dc96a9054f21985322e376c07499)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.936479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.938913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 205/414] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/groups/c620dc96a9054f21985322e376c07499 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:49.945054 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:49.957669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:49.958613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:49.959034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:49.959445 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c/groups/14f2c0165955450fb08f61ace4c8088f/roles/c215809d75234d1da0f9b9bd6cc13fb5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:49.962279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=588c912248cd46cf825987e3b8af748c, group_id=14f2c0165955450fb08f61ace4c8088f, role_id=c215809d75234d1da0f9b9bd6cc13fb5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:49.963954 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:49.981641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:49.994749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 210/415] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Aug 20 20:35:49 2022] PUT /identity/v3/projects/588c912248cd46cf825987e3b8af748c/groups/14f2c0165955450fb08f61ace4c8088f/roles/c215809d75234d1da0f9b9bd6cc13fb5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:35:50.061235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc2e7-61e4-4ad7-bac5-a50943ccd94e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:50.097301 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:50.098149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:50.098432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:50.098705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] PATH_INFO: `/v3/projects/caafa8b40709435db0e905664e3dcd9f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:50.099858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] RBAC: Authorizing `identity:get_project(project_id=caafa8b40709435db0e905664e3dcd9f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:50.101314 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:50.108091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 206/416] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:49 2022] GET /identity/v3/projects/caafa8b40709435db0e905664e3dcd9f => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:50.109500 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:50.137069 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:50.170050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:50.223039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cb431-8664-44bf-8d1e-0f802e36bee3 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:50.264045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:50.264989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:50.265367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:50.266652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] PATH_INFO: `/v3/projects/caafa8b40709435db0e905664e3dcd9f/groups/c620dc96a9054f21985322e376c07499/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:50.268725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=caafa8b40709435db0e905664e3dcd9f, group_id=c620dc96a9054f21985322e376c07499, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:50.270410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:50.286697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 211/417] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Aug 20 20:35:50 2022] PUT /identity/v3/projects/caafa8b40709435db0e905664e3dcd9f/groups/c620dc96a9054f21985322e376c07499/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:35:50.323959 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:50.336250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc8f9-c3bb-4c12-82c9-71865ff49550 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:50.381045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:50.381752 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:50.382034 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:50.382308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:50.395259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:50.400318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:50.401311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:50.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 207/418] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:35:50.408194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:50.511806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:50.535016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8ce0-ce89-436b-853f-a18217588f14 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:50.583787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:50.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:50.584697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:50.584975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:50.586082 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:50.586397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:50.587832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:50.598154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 212/419] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:50.604057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:50.714007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3551-15e6-4911-9af6-d8579ee72fbb None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:50.750878 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:50.751548 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:50.751834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:50.752108 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:50.783416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:50.846272 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:50.847777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:50.977986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 208/420] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:50.979954 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:51.117415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54290ef-6ea6-457d-a209-0b0f3f0f591c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:51.161554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:51.162227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.162505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.162780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.166376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:51.167841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:51.169468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 213/421] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:50 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:51.175368 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:51.277129 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:51.332622 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd502d-d1c5-458a-9e98-4d0143f388a5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:51.384362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:51.384963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.385244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.385517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.386658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:51.388115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e319d2-3b37-45d1-99a5-6c2c55ce389a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:51.389710 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 209/422] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:51 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:51.395960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:51.427991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:51.559882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e51a8-d93e-4f5f-aa25-40869cdafd2b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:51.609073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:51.609743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.610028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.610298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.611030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:51.611337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:51.612783 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212e3-14c3-48e1-835e-0a1dfb85b641 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:51.625786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 214/423] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:51 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:51.717046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d148-0ebb-454b-a73b-c197b724c1df None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.717400 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d148-0ebb-454b-a73b-c197b724c1df None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.717600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d148-0ebb-454b-a73b-c197b724c1df None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.719122 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 210/424] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:51.724852 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a918e9-9fb3-4c5f-9727-107d59235585 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.725141 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a918e9-9fb3-4c5f-9727-107d59235585 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.725415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a918e9-9fb3-4c5f-9727-107d59235585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.745140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-c2a918e9-9fb3-4c5f-9727-107d59235585 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:51.746367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-c2a918e9-9fb3-4c5f-9727-107d59235585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:51.817687 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 215/425] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:51.964056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30ae6-70b0-496c-a0e1-9ff66242bca1 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.964484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30ae6-70b0-496c-a0e1-9ff66242bca1 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.964616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30ae6-70b0-496c-a0e1-9ff66242bca1 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.966159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 211/426] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:51.971592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:51.971829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:51.972092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:51.984874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:51.991007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:51.992197 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:52.063197 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 216/427] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:52.173945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30ae6-70b0-496c-a0e1-9ff66242bca1 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.276668 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30ae6-70b0-496c-a0e1-9ff66242bca1 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.299849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:52.320506 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:52.320750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.321060 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.321338 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.335825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:52.341059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:52.342012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 20 20:35:52.342797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:52.345657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 212/428] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:52.348598 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.446481 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.457645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f1197-81e2-4252-b5f8-e29be9c3048b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.502465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:52.503638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.503914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.504189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.505222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] RBAC: Adding query filter params (name=member) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:52.506645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:52.508313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:52.520129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 217/429] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:52.521448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:52.527128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.583638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9dfd-d2da-44ff-9db7-7b3078252f93 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.627701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:52.628365 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.628643 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.628919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.641073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:52.645756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:52.646657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:52.647522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 213/430] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:52.654060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a9ab-3a0d-46c6-8b95-7b70c54bea8b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.656806 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.705871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:52.706893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.707220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.707496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.721570 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:52.797724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:52.799467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ff687-d124-4246-9efa-9efec91ec239 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.801798 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:52.807357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35e1-6b25-45bb-8ae1-6f2bf6da3408 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:52.836584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:52.837233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.837513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.837815 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.838621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:52.838933 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:52.840317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5296-130d-4b6d-ad57-e983b8e6687c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:52.849260 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:52.850269 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f881-a325-422f-8729-0e7d5ffb9009 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.850557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f881-a325-422f-8729-0e7d5ffb9009 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.850834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f881-a325-422f-8729-0e7d5ffb9009 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.853681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 215/432] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:52.854612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f881-a325-422f-8729-0e7d5ffb9009 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:52.917983 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 218/433] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:52.919266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:52.919548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:52.919820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:52.938833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:52.940097 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:52.970541 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f881-a325-422f-8729-0e7d5ffb9009 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:52.972985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.007618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.008249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.008533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.008809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.021648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 219/434] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:53.021648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.051414 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.085079 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.086960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b87af-80ed-45cf-ab3e-3fa1bbe12afd None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.126832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38681f-ac3f-4948-bfee-278f607ed50f None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.161271 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659c024-474a-4876-8650-9cef3237549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.161949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659c024-474a-4876-8650-9cef3237549c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.162232 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659c024-474a-4876-8650-9cef3237549c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.162629 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659c024-474a-4876-8650-9cef3237549c None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.163750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659c024-474a-4876-8650-9cef3237549c None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.165359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659c024-474a-4876-8650-9cef3237549c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.167355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 220/435] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.168441 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc7f9-6927-4ca3-b284-260e7223107a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.168725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc7f9-6927-4ca3-b284-260e7223107a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.169025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc7f9-6927-4ca3-b284-260e7223107a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.173671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 221/436] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:53.175012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbc7f9-6927-4ca3-b284-260e7223107a None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.194351 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 216/437] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:35:53.196141 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.196422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.196689 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.204861 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.216477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:53.217713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:53.284807 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 217/438] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:53.285687 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.295224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.303814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbc7f9-6927-4ca3-b284-260e7223107a None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.344996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.345988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.346260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.346555 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.347656 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.349094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.350837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 222/439] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:53.351447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.416046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fa17-66ee-4079-a790-3fa26c8ba41e None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.449644 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.450300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.450603 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.450846 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] PATH_INFO: `/v3/projects/b111b020c0524a4fb7ab59a64c9c381b` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.451969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=b111b020c0524a4fb7ab59a64c9c381b)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.453421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.457648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 218/440] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/projects/b111b020c0524a4fb7ab59a64c9c381b => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.457648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.459751 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.461250 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dced11-9310-42d1-920d-88a7aa525b0b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.503689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.504383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.504649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.504991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.515882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:53.520701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:53.521590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:53.522462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 223/441] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:53.523126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.554155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.564229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a202-e8a7-4443-bbaf-4451b7ea4dd4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.602082 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.602700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.602968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.603240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.603997 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=becf529cca0348e1a6ed9bd74200b731, scope.project.id=588c912248cd46cf825987e3b8af748c) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:53.604310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.605809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.621390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 219/442] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=becf529cca0348e1a6ed9bd74200b731 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.621390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.646301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bab7e-5fee-4af3-8be2-5ea5bb3fee6a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.687278 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.688173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.688285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.688480 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.689775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.691279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.693069 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 224/443] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.698759 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.702412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.746816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced2cb-0ab1-4850-b817-90ff5e045261 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.793310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.794128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.794406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.794676 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.795829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:53.795829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.797025 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.799083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.807880 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 220/444] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.808988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.809722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6e2f-7c0e-4b47-afd3-95ffce3d07e7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.852896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.853534 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.854602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.854865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.867923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:35:53.872666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:53.873781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 225/445] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:53.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.918696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b076c5-702f-42ba-ae71-7b0ef331b757 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:53.943940 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:53.952535 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:53.953145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:53.953420 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:53.953717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:53.954439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=b111b020c0524a4fb7ab59a64c9c381b) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:53.954746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:53.956208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:53.962247 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 221/446] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=b111b020c0524a4fb7ab59a64c9c381b&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:53.963064 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:53.983171 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42483-8ec5-4205-bb11-e63494c9b9d3 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.027848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.028650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.028999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.029277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.054298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.075779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9484fee-1792-4832-8347-ef83dfc8baa8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.107929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.109353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.114268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.114905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.115188 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.115464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.116151 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:54.116460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.117938 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.127259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 222/447] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:54.133271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.207565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.231735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 226/448] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:35:54.237384 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.259931 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d66348-81b3-493d-9d5d-c3c1ba273b80 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.296508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.303014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.303638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.303913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.304270 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.356903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fe6da-956a-4f6f-bc2a-a6676c257434 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.387769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.389253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.394865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.395515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.395796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.396074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] PATH_INFO: `/v3/projects/588c912248cd46cf825987e3b8af748c` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.397218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] RBAC: Authorizing `identity:get_project(project_id=588c912248cd46cf825987e3b8af748c)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.398711 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.400347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 227/449] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/projects/588c912248cd46cf825987e3b8af748c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:54.406037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.452370 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.508584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 223/450] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 20 20:35:54.514564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.523625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f7d56-279d-4b47-a102-f22f1a9dfc75 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.544705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.559014 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.559655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.559942 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.560216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] PATH_INFO: `/v3/groups/14f2c0165955450fb08f61ace4c8088f` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.561332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] RBAC: Authorizing `identity:get_group(group_id=14f2c0165955450fb08f61ace4c8088f)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.562828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.564401 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 228/451] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/groups/14f2c0165955450fb08f61ace4c8088f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:54.570301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.614676 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d615-72aa-4d75-a039-94d7c3615aa7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.651151 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.651794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.652047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.652357 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] PATH_INFO: `/v3/projects/caafa8b40709435db0e905664e3dcd9f` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.653469 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] RBAC: Authorizing `identity:get_project(project_id=caafa8b40709435db0e905664e3dcd9f)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.654978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.656596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 224/452] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/projects/caafa8b40709435db0e905664e3dcd9f => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:54.662052 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.667711 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77d88-ea68-4a31-82cf-534ecb1b1453 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.685814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.701735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.702334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.702622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.702875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.703595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] RBAC: Adding query filter params (group.id=14f2c0165955450fb08f61ace4c8088f, role.id=c215809d75234d1da0f9b9bd6cc13fb5, scope.project.id=588c912248cd46cf825987e3b8af748c) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:54.703897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.705334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.714123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 229/453] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/role_assignments?group.id=14f2c0165955450fb08f61ace4c8088f&scope.project.id=588c912248cd46cf825987e3b8af748c&role.id=c215809d75234d1da0f9b9bd6cc13fb5 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:54.767362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0ca7-913e-449d-b222-07fcd8a1b74b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.807083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.807740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.808023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.808297 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] PATH_INFO: `/v3/groups/c620dc96a9054f21985322e376c07499` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.809506 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] RBAC: Authorizing `identity:get_group(group_id=c620dc96a9054f21985322e376c07499)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.811042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711def6-33d2-4a84-9260-e933a46f3a50 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.812718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 225/454] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/groups/c620dc96a9054f21985322e376c07499 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:54.818957 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:54.876607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:54.925817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a068c79-5e2c-4de9-ad69-b284709daaaf None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:54.958912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:54.959527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:54.959801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:54.960067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:54.961125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] RBAC: Adding query filter params (group.id=c620dc96a9054f21985322e376c07499, role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=caafa8b40709435db0e905664e3dcd9f) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:54.961427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:54.962923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da93bc-3b65-4e72-a2ac-5fc5f8c3de0c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:54.968828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 230/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Aug 20 20:35:54 2022] GET /identity/v3/role_assignments?group.id=c620dc96a9054f21985322e376c07499&scope.project.id=caafa8b40709435db0e905664e3dcd9f&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:57.430737 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f312a-9a66-4ad2-8957-be3f381efbec None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.431834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f312a-9a66-4ad2-8957-be3f381efbec None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.432325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f312a-9a66-4ad2-8957-be3f381efbec None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.434292 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 226/456] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:57.439606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae318b-a93a-4519-bb43-1a03ac33c6be None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.440436 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae318b-a93a-4519-bb43-1a03ac33c6be None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.440871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae318b-a93a-4519-bb43-1a03ac33c6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.459897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f6ae318b-a93a-4519-bb43-1a03ac33c6be None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:57.461725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f6ae318b-a93a-4519-bb43-1a03ac33c6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:57.536447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:57.692565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01e325-2e13-4810-b252-0ba928d252d7 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.693212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01e325-2e13-4810-b252-0ba928d252d7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.693723 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01e325-2e13-4810-b252-0ba928d252d7 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.695630 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 227/458] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:57.701373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.701920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.702418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.722314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:57.723849 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:57.731674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fffaac-402e-4475-b145-109221efd279 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.732230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fffaac-402e-4475-b145-109221efd279 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.732740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fffaac-402e-4475-b145-109221efd279 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.734322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 228/459] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:57.739406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493993-3391-40f6-9cc4-e24da1be0b4b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:57.739928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493993-3391-40f6-9cc4-e24da1be0b4b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:57.740399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493993-3391-40f6-9cc4-e24da1be0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:57.758641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-1b493993-3391-40f6-9cc4-e24da1be0b4b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:57.760349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-1b493993-3391-40f6-9cc4-e24da1be0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:57.770806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:57.801756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 232/460] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:35:57.831919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:57.876402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:57.991708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d651d-11fa-4bbc-8747-547738944978 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.031007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.031652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.031933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.032207 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.042971 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.044506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:35:58.060547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:58.061547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:35:58.062450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:35:58.062450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.062450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:58.062450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 233/462] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:58.069125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758195-d114-4e06-ada5-1c37edba83d5 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.069681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758195-d114-4e06-ada5-1c37edba83d5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.070158 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758195-d114-4e06-ada5-1c37edba83d5 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.071463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.072563 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 230/463] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:35:58.078100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.078626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.079133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.098552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:35:58.100177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:35:58.100673 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.123120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.180218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 231/464] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:35:58.180402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6765ac-a2df-4165-92bc-46e479e098d7 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.181503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.219003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.219626 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.219924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.220574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.221233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:58.221540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.223660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.236480 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 234/465] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:35:58.237377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.285863 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4347f0b-0814-4c7f-8379-74ce15ee3c93 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.327426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.328144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.328491 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.328828 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.330224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.342483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.343597 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fcb2b-24d0-4936-85df-1ea77f87a3d6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.343968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:35:58.359459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:58.360564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:35:58.361610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:35:58.361610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.361610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:35:58.361610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 232/466] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:58.361610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.367495 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.382397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.383047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.383326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.383602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.394416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.395901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:35:58.410444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:58.411409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:35:58.412252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:35:58.412252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.412252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:58.412252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 235/467] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:58.412476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.479736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f3e-f00a-4d7c-805c-d26d96cc8ca2 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.514363 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.514980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.515259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.515358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f58a6-2d68-461d-be9b-984fee1522a8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.515756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.516152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.517596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.539224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 233/468] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:58 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:58.539969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.562638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.563406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.563717 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.564015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.564676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:58.564988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.566541 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.578351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.588768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 236/469] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:58.588768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.609978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.665964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef9030-2549-4ec8-a47b-efdaf8c29e92 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.703329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.704239 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.704523 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.704801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.705467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:58.705810 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.707339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.711861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85c972-c7f5-409e-9593-4ab291d01fdf None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.721023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 234/470] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:58.722704 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.754521 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.755187 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.755459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.755739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.767456 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.769889 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:35:58.788180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:35:58.789388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:35:58.790337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:35:58.790337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:35:58.790337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:35:58.790337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 237/471] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:35:58.791001 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.837422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc26613-5d68-40a7-bf1b-84881f352487 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.847180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.857891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:58.877201 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.877978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.878136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.878412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.879056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.880537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.902344 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a6073-f036-445e-98a5-0ea6c76c00e2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:58.902517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 235/472] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:58 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:58.903318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:58.960265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:58.961239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:58.961514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:58.961816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:58.962470 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:58.963984 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:58.990815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 238/473] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:58 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:35:59.047784 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a2c2-d767-4014-b714-685c2fff07e7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:59.092116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:59.093187 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:59.093742 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:59.094218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:59.095132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:35:59.095647 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:59.097318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70cfca-92b3-40d6-989b-046453317902 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:59.112240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 236/474] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:35:59.117572 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:35:59.235239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dbb3a-2479-4d4a-bb4d-aeef485220e5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:35:59.245238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:35:59.273862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:35:59.274505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:35:59.274760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:35:59.275064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:35:59.275743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:35:59.277205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001701d7-cdb3-4699-8e1d-ecd1c36896a7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:35:59.301683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 239/475] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:35:59 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:00.796458 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac192-81d3-47db-91db-153e66f6507a None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:00.796985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac192-81d3-47db-91db-153e66f6507a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:00.796985 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac192-81d3-47db-91db-153e66f6507a None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:00.798629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 237/476] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:00.804208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362bc9-ebed-4e36-934b-9934b79ae3cd None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:00.804611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362bc9-ebed-4e36-934b-9934b79ae3cd None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:00.804776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362bc9-ebed-4e36-934b-9934b79ae3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:00.823198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f7362bc9-ebed-4e36-934b-9934b79ae3cd None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:00.824414 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f7362bc9-ebed-4e36-934b-9934b79ae3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:00.895431 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 240/477] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:01.230742 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ac192-81d3-47db-91db-153e66f6507a None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.231714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7e36-4a8c-4a6e-8ad8-09b4ca97b8cd None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.232005 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7e36-4a8c-4a6e-8ad8-09b4ca97b8cd None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.232279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7e36-4a8c-4a6e-8ad8-09b4ca97b8cd None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.233920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 241/478] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:01.239044 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aedc5-c6a4-40b6-ac9d-ffc80f77b310 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.239323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aedc5-c6a4-40b6-ac9d-ffc80f77b310 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.239600 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aedc5-c6a4-40b6-ac9d-ffc80f77b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.259199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-9d5aedc5-c6a4-40b6-ac9d-ffc80f77b310 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:01.260632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-9d5aedc5-c6a4-40b6-ac9d-ffc80f77b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:01.267604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:01.341517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 242/479] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:01.364645 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ac192-81d3-47db-91db-153e66f6507a None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.380383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227270c-7f12-4e23-8f2e-090ffd446b2d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.380728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227270c-7f12-4e23-8f2e-090ffd446b2d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.380934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227270c-7f12-4e23-8f2e-090ffd446b2d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.382942 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 243/480] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:01.388790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f048-369f-4996-b627-696a56267e83 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.389339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f048-369f-4996-b627-696a56267e83 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.389830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f048-369f-4996-b627-696a56267e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.411887 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:01.412755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.413460 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-ba73f048-369f-4996-b627-696a56267e83 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:01.413608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ba73f048-369f-4996-b627-696a56267e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:01.425641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:01.431516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:01.432434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:01.433259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 238/481] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:01.440258 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.441543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:01.492190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:01.518450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e49-bb55-4072-b053-cdb05187ebe5 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.518750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e49-bb55-4072-b053-cdb05187ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.519002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e49-bb55-4072-b053-cdb05187ebe5 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.520694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 245/483] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:01.526711 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.526992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.527263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.545296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:01.551894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:01.552346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681dd4-f158-4430-b129-a21368734355 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.553818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:01.589818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:01.590578 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.591088 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.591419 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.592782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:01.592782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:01.594194 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:01.603071 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 239/484] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:01.608804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.634391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 246/485] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:01.676862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.726741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a473a-451b-4110-8b4e-4ddbba4d725b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.764425 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:01.765089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.765648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.765754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.777406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:01.779053 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:01.786808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:01.796674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:01.797964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:01.798795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:01.798795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:01.798795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:01.802069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 240/486] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:01.803929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.808628 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafa9b-7742-47b4-baea-342f67e7fe8c None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.816170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:01.849435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:01.850136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.850415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.850695 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.861385 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:01.866205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:01.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 247/487] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:01.868037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:01.919410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b871-c9ae-400e-bbfa-72f35d2b24be None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.954233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:01.954847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:01.955132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:01.955410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:01.956058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:01.956366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:01.957794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:01.969815 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 241/488] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:01.970591 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f35237-f8b6-4a31-b03a-4e2d01f9e68f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:01.971632 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.006300 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.006952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.007228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.007502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.018331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:02.022974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.023876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 248/489] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.025100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.032297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.037533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.070115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523ee7c-2f93-4b19-b0f6-7db449254096 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.105856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.106468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.106749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.107021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.107679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.108037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.109359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.117135 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 242/490] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.117944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.131632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3317e7-eed6-438f-83d9-07dc81497ccf None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.166517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.167149 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.167426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.167699 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.178134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:02.182886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.183817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:02.184619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.185272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.215908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea954-d97d-479a-b68d-a4c098c5331b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.243114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.249313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.249975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.250266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.250539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.251425 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.259007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.260530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:02.272903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.273900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 243/492] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.274804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.288500 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe94fe-22fb-4fbd-b78e-4d80af8817e5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.321858 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.322714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.322811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.323059 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.323729 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.324034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.325427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.333829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.334620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.377092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563e69e-2813-44d6-b797-be0fbf9082d9 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.412276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.412898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.413177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.413440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.423928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.425421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.435384 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4373ba-730c-489a-ad7a-9a57127d3e09 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:02.439345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.440289 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:02.441181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:02.441181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.441181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:02.441181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.441181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.464048 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.474192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.474811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.475096 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.475374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.476061 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.476345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.477748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.484784 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.485476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.489974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.545061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1936b-7682-4bb3-90ae-5bea884f1584 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.578577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.579187 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.579467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.579760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.580483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.580793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.582281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.585006 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda68ab-6012-4ff7-be0a-9e692f925404 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.617449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.618032 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.618179 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.618365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.618642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.618845 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.630159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.631615 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:02.645415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.646360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:02.647214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:02.647214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.647214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:02.647214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 252/497] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.647704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.688991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.719490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.722675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174110d7-24bb-4727-b45d-ba695ed5222c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.747646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611cc9-5f02-496c-b334-1ccb1b0efe2e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.756531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.757149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.757431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.757741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.758380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.758686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.760107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.771432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 246/498] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.772210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.781446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.782117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.782396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.782668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.793318 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.794794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:02.809162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:02.810502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:02.811492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:02.811492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:02.811492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:02.811492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 253/499] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:02.811492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.871677 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff0b6-89b2-4fdf-bd83-8799af846dd1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.900590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.905197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.905856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.906153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.906425 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.909093 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d12b-f494-408d-9441-c8a44a8342bf None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:02.934921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:02.942104 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:02.942730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:02.943001 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:02.943273 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:02.943917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:02.944215 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.945595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:02.956996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 254/500] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:02.957801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:02.975278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:02.976768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.054421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1dc42-390d-4c7d-b429-5c062b34f37f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.071984 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 247/501] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:03.072808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.089975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.090610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.090890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.091169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.098738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.100216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:03.113284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:03.114289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 255/502] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:03.115262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.130512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.135997 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.175543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c7ab5-774b-428a-a6c5-9e6d958c8c63 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.209606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.210254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.210530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.211106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.211731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:03.212026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.213478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.216354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819067c-93c1-4cc4-abd0-792c0c8d8742 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.224252 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 248/503] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:03.225031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.249712 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.250343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.250622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.250910 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.258290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.259772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:03.270644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:03.271705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 256/504] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:03.272818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.326240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426b05-88d4-4391-9c99-591afc566ce1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.344079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.346481 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.361609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.362313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.362598 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.362886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.373319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.374632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692339af-b31f-47df-919f-f28e9f301e97 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.374819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:03.388619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:03.389580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:03.390490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:03.390490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:03.390490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:03.390490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 249/505] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:03.390490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.412322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.412939 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.413223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.413495 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.414297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:03.414586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.416029 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.451220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 257/506] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:03.452042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.490267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957971-ccfa-40e1-8b9c-2ade0e041190 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.522750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.523383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.523664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.523937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.531573 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.533049 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:03.544328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:03.545218 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 250/507] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:03.546172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.550895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddcd05-3e13-45c9-81d6-fe7faaccc5e5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.578804 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.580202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.585516 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.586518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.586803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.587079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.587833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:03.588180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.589665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.606539 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 258/508] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:03.607383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.653283 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1345e9-ee83-4c27-8ca7-542b29477e0b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.685749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.686354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.686630 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.686896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.687528 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:03.687826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.689214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.701098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 251/509] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:03.702280 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.705424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df2ad-11ea-4a6b-a570-4c65a1bdab4a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.739333 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.739947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.740217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.740529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.794672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.796093 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.805542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fa59-7fe7-4575-b99e-dee71523a811 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.807498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.809002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.839040 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.839584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.839861 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.840131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:03.840851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:03.841157 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:03.842621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:03.859727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 252/510] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:03.860595 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 259/511] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:03.906219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:03.962639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187864-8ed8-4924-a82d-0c47e9465139 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:03.990959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:03.996121 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:03.996730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:03.997004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:03.997281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.002592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db73d7-4067-4cc0-9430-e2145643b11b None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.015893 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.035790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.036421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.036967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.043413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.044901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:04.056864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:04.057782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:04.058635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 260/512] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:04.059104 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.069900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.071358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.156379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ba6b-7396-4251-92b0-d8cec7fbf20e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.167798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 253/513] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:04.168641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.194378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.195004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.195280 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.195549 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.213747 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.219503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.263694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.265207 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.267346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcaf58-f71c-4b61-b7d1-6cb3fc992e47 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.299796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.300438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.300716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.300986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.310814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.312280 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:04.328501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:04.329575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:04.330485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:04.330485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.330485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:04.330485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 254/514] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:04.330485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.369353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 261/515] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:04.370567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.419669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.434304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602fbb-d933-4cd2-96e8-4e2e9e2f68d8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.435829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.468558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.469167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.469442 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.469736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.470421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:04.470571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545951b9-ad3f-4157-9aea-cde3dc4cedb2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.470741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.472155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.489225 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 255/516] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:04.490046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.508933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.509572 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.509944 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.510621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.520815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.522319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:04.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:04.537111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:04.538026 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:04.538026 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.538026 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:04.538026 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 262/517] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:04.538250 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.593557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ea30-b388-4836-9441-4747f2cbeaf0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.626929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.627545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.627832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.628110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.628763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:04.629068 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.630491 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.631849 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.634824 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202e7c-2dbd-4627-8990-81c3be695377 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.642372 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 256/518] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:04.643000 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.666372 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.671203 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.671785 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.672067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.672339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.682769 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.684240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:04.698254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:04.699154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:04.699991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:04.699991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:04.699991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:04.699991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 263/519] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:04.700228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.747664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29e087-389e-4a43-a6ac-784ab04e2907 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.780700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.781250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.781540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.781848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.782558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=551583a3f32e433cae6bbbd33e862ba0) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:04.782864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.784302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.789469 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 257/520] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/role_assignments?user.id=551583a3f32e433cae6bbbd33e862ba0&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:04.790266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.800735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7921b-025b-4894-972d-076c7c5df6ff None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.840068 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.841056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.841339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.841694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.842659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:04.842969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.844390 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.862615 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 264/521] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:04.862615 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:04.877282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.894514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:04.915220 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869190-f0c8-4069-89c2-bb3fec9672fc None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.958832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:04.959602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:04.960100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:04.960445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:04.969248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:04.970778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:04.978991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d98f-74c7-4abd-bfb9-fec18f4a25b9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:04.982824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:04.983781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 258/522] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:04.984826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.022899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.023758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.024183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.024601 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.025450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.025887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.027735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.044315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 265/523] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.045202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.099125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856adf-607f-4fbb-964b-bbd9eb461bcb None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.123090 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.138080 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.138728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.139020 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.139273 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.146589 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.148249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.155482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ea5-8ce0-41d3-80ce-34b04229112f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:05.160293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:05.161146 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:05.162043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 259/524] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:05.162643 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.171504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.198278 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.199009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.199342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.199696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.200462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.200834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.202351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.220965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 266/525] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.226762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.274892 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ae-9db6-4c2e-8797-b104885ede50 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.321326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.322116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.322541 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.322898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.330496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.331981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.337151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9044-914c-4412-8b3a-aab43b879f76 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:05.343910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:05.344944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:05.346090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:05.349764 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 260/526] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:05.350657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.375824 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.382707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.383843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.384127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.384497 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.385341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.385892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.387427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.399231 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 267/527] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.400165 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.427849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.475115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8ce0-5e5c-47a9-a548-abe7780617b1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.512763 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857d0a-0d10-4ffb-a5c9-4b5ebd3e9442 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.516662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.517136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.517576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.518577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=032ee4c6594a4085899e30d2e96bb783) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.518887 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.520346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.526520 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 261/528] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/role_assignments?user.id=032ee4c6594a4085899e30d2e96bb783&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.530947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.549982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.550616 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.550899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.551180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.551890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.552195 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.553771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.573955 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 268/529] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.575959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:05.660385 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.665225 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52aff-37a9-4029-8dec-c52a112d9f71 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.699210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:05.707152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.707898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.708185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.708450 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.709240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed64374e93484949aeca834b88b14e42) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.709556 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.711473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db38a-d8c9-4eed-8291-0ffdabea6da6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.723433 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 262/530] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/role_assignments?user.id=ed64374e93484949aeca834b88b14e42&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:05.738021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b8d4d-8831-407e-b2a0-9ba86f7633ac None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:05.781063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:05.781726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:05.782006 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:05.782281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:05.783032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=3624329d433947bf941772510a5423fb) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:05.783342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:05.784844 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79572bc0-347c-4182-b6e6-91652898af14 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:05.797791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 269/531] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:05 2022] GET /identity/v3/role_assignments?user.id=3624329d433947bf941772510a5423fb&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:06.979055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a5ed3-e984-44fd-af22-f2f011dcf5e9 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:06.979627 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a5ed3-e984-44fd-af22-f2f011dcf5e9 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:06.979627 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a5ed3-e984-44fd-af22-f2f011dcf5e9 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:06.981085 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 263/532] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:06.986618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cf968-1e24-482b-989b-31de8819a49b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:06.987410 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cf968-1e24-482b-989b-31de8819a49b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:06.987873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cf968-1e24-482b-989b-31de8819a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.007004 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-474cf968-1e24-482b-989b-31de8819a49b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:07.008482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-474cf968-1e24-482b-989b-31de8819a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:07.075492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 270/533] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:07.398128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a5ed3-e984-44fd-af22-f2f011dcf5e9 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:07.503502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a5ed3-e984-44fd-af22-f2f011dcf5e9 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:07.538767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:07.539811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:07.540283 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:07.540745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.552027 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:07.557019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:07.557944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:07.558796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:07.561358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:07.567380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cf968-1e24-482b-989b-31de8819a49b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:07.615725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:07.680477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cf968-1e24-482b-989b-31de8819a49b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:07.715671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:07.716289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:07.716566 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:07.716838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.717506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:07.717833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:07.719235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0f8e-223d-4d06-8a86-d67a8f1ab06b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:07.727699 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:07.733142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:07.789806 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:07.815140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7499f7-5c6f-4cc3-98a5-e78596ca441d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:07.815495 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7499f7-5c6f-4cc3-98a5-e78596ca441d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:07.815700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7499f7-5c6f-4cc3-98a5-e78596ca441d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.817287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 272/536] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:07.822345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:07.822636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:07.822911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.841600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4723d-a8d8-4d7d-bdbe-a7dfcca8e38b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:07.842800 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:07.844041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:07.881710 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:07.882786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:07.883262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:07.883722 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:07.896995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:07.899018 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-cca0cb2e-7821-40af-8d67-eee58b3bddc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:07.915990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:07.916983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:07.917886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:07.917886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:07.917886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:07.924291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 265/537] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:07.924426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 273/538] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:07.925886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:07.966904 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.009307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c263c7-592c-4c49-8e03-d47f82159268 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.010332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c263c7-592c-4c49-8e03-d47f82159268 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.010800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c263c7-592c-4c49-8e03-d47f82159268 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.012584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 266/539] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:08.017669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c10e-e7a8-48f7-a03e-a1c96ac70362 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.017958 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c10e-e7a8-48f7-a03e-a1c96ac70362 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.018233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c10e-e7a8-48f7-a03e-a1c96ac70362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.036164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c8c1-b401-4015-84e2-0d298682a0fd None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.036658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-bb94c10e-e7a8-48f7-a03e-a1c96ac70362 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:08.037993 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-bb94c10e-e7a8-48f7-a03e-a1c96ac70362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:08.071692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.072353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.072667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.072938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.073584 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:08.073914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.075351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a102-8fdd-46ac-be3b-c9ddb19c642d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.088821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 274/540] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:08.090342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfc86-8c0e-409e-94c5-202396af0acc None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.090630 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfc86-8c0e-409e-94c5-202396af0acc None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.090907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfc86-8c0e-409e-94c5-202396af0acc None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.092406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 275/541] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:08.097182 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cfc86-8c0e-409e-94c5-202396af0acc None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.118111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 267/542] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:08.119319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.119619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.119900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.148383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:08.150492 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:08.189300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.204627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.211320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cfc86-8c0e-409e-94c5-202396af0acc None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.240086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 268/543] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:08.254168 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.255036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.255488 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.255901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.264219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.264560 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.267354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:08.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.281741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:08.282760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:08.285551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 276/544] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:08.291107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.388227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e144b5-38cc-4ea9-86e9-fd9f7a174323 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.410605 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a81003-97d7-4d55-ad94-bd25aed78c4e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.424752 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.425780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.426255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.426850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.437996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:08.443262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.444177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.444999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:08.447028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 269/545] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:08.448025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.448665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.448948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.449222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.453755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:08.453755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.453755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.454025 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.470779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 277/546] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:08.471840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.486491 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.495241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.573178 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406aa4-845c-4060-9e5b-4874d8b98eb8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.580873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286cd4e-4dc1-46b0-ab1d-b10c214aeccc None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.606990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.607618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.607878 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.608143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.608795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:08.609110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.610531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.614505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.615142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.615439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.615695 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.618332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 270/547] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:08.619105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.625653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:08.630335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.631415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 278/548] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:08.637268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.708655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.714556 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.726602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35060-3eaf-44d6-a17b-cee8e19bc743 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.731482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccef4f-6ede-4b7c-b802-3f179c1788d6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.758534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.759160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.759437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.759705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.765286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.765946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.766223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.766868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.770021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.771464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.776960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:08.781705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.782707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 279/549] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:08.783520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:08.785445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.786392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:08.792447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:08.792447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:08.792447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:08.792447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 271/550] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:08.792447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.886429 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15434-0dce-40f4-8006-4c8425bb78d3 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.886890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7bf5e-c6d4-4f1f-a4c1-ffdc82b9db1c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:08.918309 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.918906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.919184 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.919287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:08.919454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.919918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:08.920100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:08.920200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:08.920739 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.920900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:08.921805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.923046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.929974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 272/551] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:08.930762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:08.933235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:08.937084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:08.938607 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:08.953386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:08.954531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:08.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:08.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:08.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:08.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 280/552] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:08.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.034214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b61d3d-da02-4aea-a742-fb7bfc843c15 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.054964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d77f6-2603-44df-a9e6-b51c9483ed61 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.066781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.067381 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.067657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.067927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.068585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.069207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.070300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.078320 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 273/553] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.079112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.093522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.094191 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.094504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.094807 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.095503 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.095847 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.097230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.109064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 281/554] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.109889 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.144441 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.165451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.181601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906705a-b4b2-45bc-b640-fbf5b93bc0b6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.215724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359ff60-5162-4d07-ab1a-ffed2f7f100c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.215919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.216549 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.216829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.217100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.227420 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.228937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:09.242670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:09.243583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:09.244592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:09.244592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:09.244592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:09.244592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 274/555] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:09.244592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.254028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.254650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.254928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.255196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.255839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.256140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.257527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.269017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 282/556] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.270029 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.349029 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438926-5107-421b-96fb-4dbd3d8850ac None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.364495 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.368612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa1b-3dee-4330-bc3a-ffe0b72cd110 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.377338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.382665 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.383313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.383592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.383919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.395040 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.396572 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.402389 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.403028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.403310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.403585 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:09.410227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:09.411155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:09.412036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:09.412036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:09.412036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:09.412203 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.412282 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 275/557] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:09.412841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.412916 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:09.425907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:09.426981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 283/558] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:09.428815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.515482 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b588-8fd7-4c77-a44e-4f389db8c1a0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.530483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730989b9-1966-4560-9773-af02d56a9b1f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.553230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.553874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.554157 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.554468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.555097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.555400 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.556836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.568389 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 276/559] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.569177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.569287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.569958 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.570236 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.570506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.579242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.580669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:09.591860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:09.592969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 284/560] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:09.594002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.601324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.622922 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.685501 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106de7-2ac1-4c55-8589-21a5a1d97e87 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.695016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8038f-3f68-46ce-8996-c69f3374c796 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.720576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.721186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.721461 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.721757 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.722398 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.722721 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.724078 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.728740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.729356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.729648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.729926 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.730610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.730911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.732331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.734991 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 277/561] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.735779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.744039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 285/562] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.745239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.825323 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.835449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:09.839645 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c572a-7ce7-4800-8900-77fac9b2450b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.847612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1862-4ac0-46e5-b266-c693c199db65 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:09.873579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.874240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.874523 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.874799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.880839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:09.881454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:09.881767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:09.882043 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:09.882142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.882773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:09.883077 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:09.883579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.884513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:09.894454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:09.895584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:09.896533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 278/563] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:09.897277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:09.901781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 286/564] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:09.902445 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.004682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0377-a9e7-4f83-9dfa-a88ee622889e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.009731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ef3bc-cfa1-46ab-ad93-00730781eba4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.040292 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.040963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.041233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.041505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/551583a3f32e433cae6bbbd33e862ba0/roles/adcba7f4047a4bf1830c13e93ea560d5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.044059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.044698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.044965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.045231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.052841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.054348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.056237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=551583a3f32e433cae6bbbd33e862ba0, role_id=adcba7f4047a4bf1830c13e93ea560d5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.057828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.060799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:10.065464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.066587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:10.067596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 279/565] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.068213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.074899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 287/566] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:36:09 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/551583a3f32e433cae6bbbd33e862ba0/roles/adcba7f4047a4bf1830c13e93ea560d5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:36:10.076029 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.087353 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.188299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8370-3ee5-4775-b7ae-9cc8b1ad2de8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.188533 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a013a-d174-4a27-9197-553f1c749f61 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.224961 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.225214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.225583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.225846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.225967 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.226129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.226228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.226401 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.226943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:10.227188 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.228744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.237663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.239152 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.252445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 280/567] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:10.253671 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:10.259394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.260416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:10.261771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:10.261771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.261771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:10.261771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 288/568] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.261771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.318296 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.327404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.372044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5966-0dbc-472c-9afe-f47166583973 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.375846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79298-744b-458b-9d1b-f21c5cf5e6ab None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.407966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.408584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.408868 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.409142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.409894 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:10.410203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.410591 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.411235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.411518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.411687 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.411904 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.425356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.426869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.434467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 281/569] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:10.436088 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:10.441892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.442874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:10.444454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:10.444454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.444454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:10.444454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 289/570] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.444454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.553246 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39723e2-e8c4-44fa-b4a0-9c9ef6bdbb10 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.555777 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.558726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1025-17e1-40e6-aaf4-2f6f1e2cfe37 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.578065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.590617 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.591348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.591708 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.591965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.592619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:10.592927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.594355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.600203 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.601430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.602016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.602429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.606087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 282/571] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:10.606966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.614981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.616448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:10.630799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.631721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:10.632588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:10.632588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:10.632588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:10.632588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 290/572] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.632588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.716847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdd7f3-e4e6-4e79-8103-341131f06e29 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.747063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4b72-ffce-48d1-84b3-6a6d46549a1f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.750884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.751556 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.751842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.752116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.752758 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:10.753062 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.754520 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.770445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 283/573] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:10.770445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.785902 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.786655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.786938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.787211 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.795331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.796913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:10.808335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:10.810622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:10.816577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 291/574] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.816577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.817365 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.831903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:10.873194 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c4ce7-a9bc-4390-9e92-81dd0d91d4e6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.910288 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.910790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.911070 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.911403 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.911980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:10.912284 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.913844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.919744 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cae8f-2c1a-4657-84fc-68c0a689a91d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:10.930104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 284/575] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:10.930104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:10.958105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:10.958843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:10.959180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:10.959515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:10.966655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:10.968189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:10.979201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:10.980256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:10.981180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 292/576] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:10.981716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.035103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3023e-cb08-45c8-89e8-15b70abc8171 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.037532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:11.063062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:11.072536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.073211 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.073803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.073803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.074488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:11.074798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.076247 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.089007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 285/577] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:11.090755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.100214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73ef2-3b05-4db4-a683-9226c2c203a8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.134226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.134965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.135348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.135516 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.142718 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.144198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:11.155950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:11.157033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 293/578] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:11.158009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.206486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f2ba-413a-4777-b189-791b1813c621 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.241766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.242535 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.242909 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.243275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.244083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:11.244483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.246044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.257902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 286/579] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:11.258617 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.276642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ed68-9baa-46db-b104-c27a6d63352e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.284517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:11.308665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:11.322731 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.323826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.323826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.323992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/032ee4c6594a4085899e30d2e96bb783/roles/adcba7f4047a4bf1830c13e93ea560d5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.341128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=032ee4c6594a4085899e30d2e96bb783, role_id=adcba7f4047a4bf1830c13e93ea560d5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.342648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.358326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 294/580] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:36:11 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/032ee4c6594a4085899e30d2e96bb783/roles/adcba7f4047a4bf1830c13e93ea560d5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:36:11.359371 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.385950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88ce81-ba59-417b-ab2e-31ea49af5485 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.438872 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.440016 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.440472 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.441118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.442511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:11.443256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.445715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.464787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 287/581] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:11.470575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:11.497058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792006e-4750-4f37-87c2-02891b1487e8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.539469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.540801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.541127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.541493 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed64374e93484949aeca834b88b14e42/roles/adcba7f4047a4bf1830c13e93ea560d5` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.564300 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=ed64374e93484949aeca834b88b14e42, role_id=adcba7f4047a4bf1830c13e93ea560d5)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.566329 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ad91b-b197-4451-a9bf-2a49d580a541 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.586780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 295/582] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:36:11 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed64374e93484949aeca834b88b14e42/roles/adcba7f4047a4bf1830c13e93ea560d5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:36:11.597372 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:11.618386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a94634-d5f4-4eaa-a300-2c4b76cf6ae0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:11.659113 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:11.659799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:11.660131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:11.660594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/3624329d433947bf941772510a5423fb/roles/adcba7f4047a4bf1830c13e93ea560d5` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:11.679088 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=3624329d433947bf941772510a5423fb, role_id=adcba7f4047a4bf1830c13e93ea560d5)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:11.680686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0c89b-ab1a-4ac9-9cce-158fe56c9936 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:11.700391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 288/583] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:36:11 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/3624329d433947bf941772510a5423fb/roles/adcba7f4047a4bf1830c13e93ea560d5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:36:12.248450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59cb4-4043-4c56-a669-df7113d3b0f6 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:12.248984 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59cb4-4043-4c56-a669-df7113d3b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:12.248984 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59cb4-4043-4c56-a669-df7113d3b0f6 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:12.250628 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 296/584] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:12.255950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:12.256341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:12.256496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:12.275900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:12.277082 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:12.348190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 289/585] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:12.671716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d59cb4-4043-4c56-a669-df7113d3b0f6 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:12.702982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:12.779843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d59cb4-4043-4c56-a669-df7113d3b0f6 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:12.816232 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:12.817253 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:12.817775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:12.818269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:12.829050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:12.834498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:12.835451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:12.836667 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:12.839413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 297/586] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:12.849649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:12.915896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:12.955319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6febd6-981e-4ee4-9830-a13eddfa786b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:12.988948 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:12.989558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:12.989863 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:12.990135 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:12.990795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:12.991103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:12.992481 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.000812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 290/587] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:13.006310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:13.103599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:13.114235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48849d10-c1c7-422a-932d-ecbf565bc454 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:13.149152 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:13.150176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.150733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.151220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.161902 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:13.163629 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:13.179305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:13.180395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:13.181376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:13.181376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:13.181376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:13.183620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 298/588] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:13.194750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:13.299626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd1da-0aaf-40e9-8a91-5fb027657d30 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:13.326243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:13.334194 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:13.334840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.335120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.335386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.336487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:13.336819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:13.338309 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.350825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 291/589] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:13.356877 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:13.464864 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804267c-1cf6-4cc8-8418-8579a5986e04 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:13.504305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:13.505406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.505938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.506416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.515081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:13.516896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-f5780758-4c58-4ba8-a58f-2ecf437c0615 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:13.528618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:13.529590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:13.530685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:13.533200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 299/590] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:13.538763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:13.643497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432788d-efca-4c1d-afbc-71a693e1eec3 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:13.653150 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f89bd-8c04-46a9-8b48-a33bfb549813 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.653509 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f89bd-8c04-46a9-8b48-a33bfb549813 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.653759 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f89bd-8c04-46a9-8b48-a33bfb549813 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.655305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 300/591] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:13.661603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75e9c-61cc-442a-9b07-9c4e5e71c562 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.661986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75e9c-61cc-442a-9b07-9c4e5e71c562 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.662228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75e9c-61cc-442a-9b07-9c4e5e71c562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.670244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:13.683551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-eac75e9c-61cc-442a-9b07-9c4e5e71c562 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:13.684810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-eac75e9c-61cc-442a-9b07-9c4e5e71c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:13.690160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:13.691090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.691560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.692022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.693095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:13.693629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:13.695254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.718383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 292/592] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:13.719568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:13.763078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 301/593] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:13.770460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:13.826049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ee1d-445b-4c2b-b1a4-b466a38bfbb3 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.826371 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ee1d-445b-4c2b-b1a4-b466a38bfbb3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.826712 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ee1d-445b-4c2b-b1a4-b466a38bfbb3 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.828266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 302/594] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:13.829661 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615349-495b-4362-ade0-4372feef2dab None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:13.841719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4587f6-9a5f-4de8-814b-dd227f2ae3f4 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.842373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4587f6-9a5f-4de8-814b-dd227f2ae3f4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.842862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4587f6-9a5f-4de8-814b-dd227f2ae3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.863905 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-9b4587f6-9a5f-4de8-814b-dd227f2ae3f4 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:13.865557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-9b4587f6-9a5f-4de8-814b-dd227f2ae3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:13.870369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:13.870718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:13.870957 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:13.871228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:13.945023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:13.945023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:13.945835 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 303/595] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:13.989902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.012922 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f41c-688c-427b-9680-19d5513dd5d8 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.013527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f41c-688c-427b-9680-19d5513dd5d8 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.014139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f41c-688c-427b-9680-19d5513dd5d8 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.016031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 304/596] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:14.023140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.023721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.024112 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.046389 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 293/597] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:14.049820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:14.051417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:14.051566 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.125119 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.134995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 305/598] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:14.136538 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.163929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7519a6-fce6-4140-94b1-bfcca9b2936a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.212139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.213012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.213427 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.213893 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.224658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.226299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.229571 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:14.243447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.244640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:14.245728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:14.245728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:14.245728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:14.251879 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 294/599] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:14.252912 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.264417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba9332-0094-4341-bff5-b3de59f860cb None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.300126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.300780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.301057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.301322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.314321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:14.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.322030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 306/600] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:14.322976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.368701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0798d-9ad7-48b7-a664-20e855d2f31b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.379854 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.405735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.406728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.407537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.407987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.408817 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:14.409270 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.410824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.422975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 295/601] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:14.423941 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.430028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3731a-24f4-48f1-b912-b10d634df9c6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.466800 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.467383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.467665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.467943 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.477969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:14.478536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:14.482661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.483762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 307/602] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:14.484595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.524670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b98d-0cb5-4ff3-8a76-1ac50c6974a7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.558409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.559023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.559307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.559580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.560244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:14.560553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.561990 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.569790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 296/603] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:14.570622 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.584290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171119-aa6a-4334-97f7-f3bfa519e283 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.599469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.620999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.621734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.622290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.622290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.629574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.631060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:14.642177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.643113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 308/604] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:14.644007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.679923 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656881e-afb7-4a61-ab36-4e2a42fbcb76 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.696699 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.713880 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.714509 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.714789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.715061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.724962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:14.730105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.731055 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:14.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 297/605] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:14.732633 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.744331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197daddf-63c4-4c9c-b293-48caba54b3c4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.777961 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.778570 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.778848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.779118 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.779842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:14.780150 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.781545 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.789513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 309/606] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:14.790894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.827228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.837426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08b4a-bb94-436c-a38a-afc144dba25c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.870500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.871130 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.871403 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.871671 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.881515 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.883026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.892062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f69b-4777-407c-bd1c-c6b7eff76910 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:14.897274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:14.898316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:14.899349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:14.899349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:14.899349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:14.899349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 298/607] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:14.899962 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:14.925537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:14.926204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:14.926487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:14.926770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:14.927466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:14.927777 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:14.929219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:14.932639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:14.940876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 310/608] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:14.941700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.001867 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebcb4-bcb1-4c36-aa17-39af9e27d1cb None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.031035 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.035420 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.036030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.036319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.036579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.037276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.037407 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635c10f-ed91-499a-9e9e-77d8475958c4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.037568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.039041 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.047045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 299/609] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.047754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.074432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.075075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.075353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.075625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.085458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.087326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:15.102249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:15.103353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:15.104386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:15.104386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:15.104386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:15.104386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 311/610] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:15.104386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.140210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.150299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca93268-4315-4d07-a930-9a94eea262d1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.182610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.183197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.183472 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.183740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.184374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.184674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.186097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.199071 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 300/611] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.199947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.207174 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60e2c-e0e4-4f8d-9d37-a5d301bca40e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.242395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.243001 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.243284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.243556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.244286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=551583a3f32e433cae6bbbd33e862ba0) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.244610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.246074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.251837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 312/612] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/role_assignments?user.id=551583a3f32e433cae6bbbd33e862ba0&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.252685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.282041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.314518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d630-7121-4d33-b0e5-a4ae959c968f None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.354075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.354736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.355018 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.355290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.366457 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.367986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:15.385277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:15.386873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:15.388086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:15.388086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:15.388086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:15.388086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 301/613] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:15.388086 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.394773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162e339-a4b5-4f12-8ed0-eaf83ceaabb6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.396116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.432467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.433089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.433373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.433677 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.434334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.434646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.436766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.449568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 313/614] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.450235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.518408 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed47a0c-2d35-475d-b698-1af6d9c989f5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.538320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.554547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.555183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.555460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.555731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.563407 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.564866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.568815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265e83-1a66-43c6-a45d-1518d946d774 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:15.575981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:15.576952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 302/615] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:15.578336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.611428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.612051 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.612336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.612614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.613263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.613567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.614985 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.626809 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 314/616] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.627627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.652856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.692988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f3df-fd07-402f-a1b3-a8aafca2fd8a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.729545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.730344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.730536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.730805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] PATH_INFO: `/v3/users/glance` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.739266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.740802 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.750508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344763c0-d5bb-4583-bba6-b70d66d5b110 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:15.752567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:15.753731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:15.754692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 303/617] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:15.755297 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.787766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.794473 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.795840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.798034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.798313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.799196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.799583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.801745 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.825996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 315/618] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.825996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.863061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300069-aa2f-4cb3-8148-67c6ac26c57d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.886634 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:15.897811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.898449 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.898730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.899004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.906637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.908092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:15.919396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:15.920359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 304/619] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:15.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:15.935738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b18e-ba38-400b-a29d-f11afb41e61a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:15.972454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:15.973068 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:15.973348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:15.973635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:15.974373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:15.974680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:15.976128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:15.999111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 316/620] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:15.999963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.025511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22971-2ad7-469a-8084-15c2bbbb8ebe None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.051726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.062042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.063959 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.064636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.065182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.106870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdf5ba-c4ce-46d8-95bf-dc7210ffab8f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.122131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.139572 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.141144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.143174 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.143796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.144081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.144352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.145081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:16.145382 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.146853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.164020 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 317/621] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:16.165124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.263445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 305/622] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:16.264312 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.271715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d102-04ba-446d-9fea-09ce13a38907 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.280527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.317919 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.318480 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.318783 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.319046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.360488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.377998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c323-dc21-4382-8978-8847aff06c9c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.394795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.396466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.415675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.416361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.416638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.416910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.491131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.493229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.506693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 318/623] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:16.506693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.515449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.577883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.595044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 306/624] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:16.596014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.617291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18c36-629c-44e6-af28-c62774208f44 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.653502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.654176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.654457 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.654728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.665369 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.666918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:16.681257 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:16.682287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:16.683710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:16.683710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.683710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:16.683710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 319/625] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:16.683710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.716303 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aeaad-b005-452b-aeb0-6076cd31e207 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.751746 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.753826 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.754496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.754759 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.755045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.765910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.767451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:16.782786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:16.783771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:16.785265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:16.785265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.785265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:16.785265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 307/626] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:16.785265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.804258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05be2-0932-41df-bd02-1db91d450768 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.821839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:16.841978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.842548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.842833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.843109 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.854698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.856161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:16.870550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:16.871514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:16.872447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:16.872447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:16.872447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:16.872447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 320/627] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:16.872447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.898544 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f996-7819-48e7-9162-9dec01d9beac None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.932498 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:16.933111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:16.933392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:16.933697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:16.934334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:16.934637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:16.936028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:16.947095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 308/628] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:16.952272 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:16.979973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316255-b714-4118-ad77-61dde0852b7e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:16.990733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.015692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.016314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.016595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.016875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.017550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.017876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.019273 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.035991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 321/629] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.035991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.051739 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.058539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13bca-01fe-4687-89da-2e928a5faa5a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.095089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.095625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.095908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.096184 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.096833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.097138 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.098564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.115120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 309/630] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.116007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.142032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e58ea-5598-4630-a9b3-49075959bd8a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.175510 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.176157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.176442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.176718 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.183367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.184827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:17.196226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:17.197345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:17.198483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 322/631] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:17.199003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.233111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.234290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafba83-f71a-4f55-90aa-37fd9440c6e9 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.272141 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.272738 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.273022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.273295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.280268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.281765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:17.293835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:17.294794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 310/632] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:17.300816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.318352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddfd8d-ff4b-45d2-97eb-49f2b9272da4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.324035 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.359009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.359569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.359853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.360128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.366847 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.368319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:17.379505 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:17.380590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 323/633] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:17.381698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.424753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626627a-8215-44bb-9b54-5d091fe3bc9d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.465423 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.466056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.466336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.466690 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.467299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.467613 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.469059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.478142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.481440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 311/634] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.486716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.489020 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea122-9bd1-4927-bb1e-66be19127eba None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.522471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.523085 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.523373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.523645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.524348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.524659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.526208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44271-e9ac-4e87-8e01-6da26afa7174 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.537873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 324/635] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.539083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f173-1eb4-4ce6-8f36-9266139872c7 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.539372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f173-1eb4-4ce6-8f36-9266139872c7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.539707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f173-1eb4-4ce6-8f36-9266139872c7 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.540890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 325/636] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:17.541642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f173-1eb4-4ce6-8f36-9266139872c7 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.566453 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.591064 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633f40a-2455-4c2d-a989-9e94ed8dbe38 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.623333 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.623873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.624147 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.624398 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.625076 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.625378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.626862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.639574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 312/637] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.640346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f173-1eb4-4ce6-8f36-9266139872c7 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.640477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.679346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.679960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.680242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.680513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.681237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=032ee4c6594a4085899e30d2e96bb783) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.681547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.683067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84635f3-719b-4ec3-b4e4-c522310f4c22 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.697768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 326/638] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/role_assignments?user.id=032ee4c6594a4085899e30d2e96bb783&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.697768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.697768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.697768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.714463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:17.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:17.726790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.754663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de608e9-3db5-4234-9c25-4a6978f5e0de None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.793928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 327/639] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:17.793928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:17.803617 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.804255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.804530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.804804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.805819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed64374e93484949aeca834b88b14e42) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.805994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.807525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.812207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:17.826224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 313/640] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/role_assignments?user.id=ed64374e93484949aeca834b88b14e42&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:17.908850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9cb2a-5525-460e-9e73-edce9d5110ff None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:17.946736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:17.947692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:17.948195 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:17.948623 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:17.949421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=3624329d433947bf941772510a5423fb) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:17.949779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:17.951276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:17.961764 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 328/641] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:17 2022] GET /identity/v3/role_assignments?user.id=3624329d433947bf941772510a5423fb&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:18.116952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:18.224159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970335-8730-4ef9-aee8-0ad32868e451 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:18.259550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:18.260291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:18.260574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:18.260851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:18.271583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:18.276808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:18.277860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:18.278787 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 314/642] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:18.284165 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:18.316078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:18.395386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894565a-82f4-4cc1-8d74-72b7f6364339 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:18.430264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:18.430881 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:18.431163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:18.431438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:18.432170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:18.432477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:18.433893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:18.449048 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 329/643] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:18.460563 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:18.561895 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:18.605381 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60c7d1-f885-4c08-b5c1-0e1dfd0ecc86 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:18.640081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:18.641059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:18.641540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:18.642036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:18.652978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:18.654698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:18.668929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:18.669900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:18.670850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:18.670850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:18.670850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:18.672839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 315/644] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:18.678136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:18.748894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:18.780184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658a99-b722-49d5-a163-7896b38cca4a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:18.820813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:18.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:18.822331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:18.822801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:18.823678 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:18.824194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:18.825877 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:18.838882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 330/645] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:18.846779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:18.958267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490c45-cad5-49f6-9ca5-02d26eea23dd None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:18.973106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:19.012981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:19.013975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:19.014461 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:19.014909 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:19.031177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:19.032899 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:19.045219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:19.046229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:19.047203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:19.049559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 316/646] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:19.055405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:19.160985 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5487-5f39-4a74-8931-b4f27c29d501 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:19.193430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:19.202134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:19.202134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:19.202134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:19.202134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:19.203179 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:19.203651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:19.205273 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:19.231008 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 331/647] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:19.238448 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:19.355879 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eaa4d-58c6-47cc-b8c4-d732310157ec None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:19.396376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:19.397966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:19.398819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:19.399536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:19.448974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:19.476483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:19.478165 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:19.598493 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 317/648] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 20 20:36:19.604815 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:19.739573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19d1e7-d48a-495f-89eb-2e9a2587160e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:19.785155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:19.786227 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:19.786752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:19.787459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:19.807173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:19.809267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:19.832862 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:19.833920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:19.834851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:19.834851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:19.834851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:19.838112 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 332/649] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:19.843869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:19.915291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:19.950884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cded21-5239-4272-8bf3-4da774917966 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:19.987159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:19.988154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:19.988655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:19.989121 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:19.990047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:19.990551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:19.992132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fea3-d52d-4d56-8eb8-da6d4c5d5260 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.004559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 318/650] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:20.010345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.055059 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.095600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd323e-cb20-4344-a4b5-4eb39aa91dc8 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.096513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd323e-cb20-4344-a4b5-4eb39aa91dc8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.096994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd323e-cb20-4344-a4b5-4eb39aa91dc8 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.099329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 319/651] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:20.104220 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492444-e4d3-4388-b411-2a49158da22f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.104510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492444-e4d3-4388-b411-2a49158da22f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.104805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492444-e4d3-4388-b411-2a49158da22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.125033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e88c89-ad8d-4cf4-86cf-a5f4e7cfa914 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.125299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-7e492444-e4d3-4388-b411-2a49158da22f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:20.126364 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-7e492444-e4d3-4388-b411-2a49158da22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:20.172362 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.173583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.174242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.174891 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.183365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.185078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:20.196960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:20.198002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:20.198915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:20.201252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 333/652] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:20.207288 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.221776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 320/653] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:20.299697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976202-1b5d-4c9a-a2d9-a044cfba70f7 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.299999 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976202-1b5d-4c9a-a2d9-a044cfba70f7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.300184 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976202-1b5d-4c9a-a2d9-a044cfba70f7 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.301770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 321/654] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:20.306677 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76598f6-c0fa-4b81-999f-17a25c24ad96 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.306964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76598f6-c0fa-4b81-999f-17a25c24ad96 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.307233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76598f6-c0fa-4b81-999f-17a25c24ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.330979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.334234 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49017-966c-4942-b011-52c6ee1468db None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.343637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-e76598f6-c0fa-4b81-999f-17a25c24ad96 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:20.345505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-e76598f6-c0fa-4b81-999f-17a25c24ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:20.377644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.377644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.377644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.377644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.378116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:20.378116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.379049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb33-a678-4f68-a943-27c4a0586230 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.391696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 334/655] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:20.393028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111cfb0-0e2c-45cf-ad67-af16ff6195ce None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.393315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111cfb0-0e2c-45cf-ad67-af16ff6195ce None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.393584 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111cfb0-0e2c-45cf-ad67-af16ff6195ce None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.395898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 335/656] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:20.397322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111cfb0-0e2c-45cf-ad67-af16ff6195ce None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.420169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.430681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 322/657] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:20.432030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.432321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.432597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.450262 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:20.451834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:20.532801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111cfb0-0e2c-45cf-ad67-af16ff6195ce None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.534031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 323/658] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:20.548791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.575922 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.577512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.578039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.578774 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.580370 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=551583a3f32e433cae6bbbd33e862ba0) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:20.580912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.583683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.597650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 336/659] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/role_assignments?user.id=551583a3f32e433cae6bbbd33e862ba0&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:20.660864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447b6e1-a6b6-4918-967c-7fb7497ff3c7 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.686512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.699506 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.700156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.700431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.700698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.701285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.702735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:20.714618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:20.715691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.716530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 324/660] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:20.722122 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.749418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.756928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.840396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4721f5-5755-4e19-8659-8a48a127d7bd None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.875703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.876430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.876708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.876978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.877604 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:20.877931 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.879414 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.885982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 337/661] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:20.885982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.892905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce252da-37f8-42b2-8c98-c3d23d5acb19 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:20.928387 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:20.929132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:20.929412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:20.929719 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:20.930310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:20.931753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:20.940743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:20.942067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:20.942942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 325/662] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:20.943741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:20.987805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:20.997124 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:21.001517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d428705-b5b9-43ec-950e-c4cd56cecb2d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.038074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.039110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.039391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.039808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] PATH_INFO: `/v3/services/network` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.040390 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.041834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.050439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca15698-698b-45fe-84f7-efa8e3b8c6e8 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:21.052636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:21.053646 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:21.058169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 338/663] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:21.058999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:21.093231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.094180 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.094636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.095097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.095897 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:21.096377 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.097970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.103945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 326/664] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:21.104946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:21.193848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3f6a-e530-49f3-a36c-b2b2cdd4a97c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.220891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d710fa-2bad-4150-948d-9fabb4581206 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.242507 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.243576 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.244080 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.244713 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.245521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:21.246221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] RBAC: Adding query filter params (name=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:21.246899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.249241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.255335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 339/665] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:21.260738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:21.276629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.277727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.278206 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.278670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.279600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] RBAC: Adding query filter params (name=network) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:21.280114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.281804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.283589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:21.288197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 327/666] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:21.294709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:21.399021 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8a29-789a-4f51-bcf1-d795aa23e7ef None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.413428 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e24b-b175-414e-acc6-3b6985c4023e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:21.442884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.443754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.444032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.444304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.445650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:21.445989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.447796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362768d3-aadd-4bd5-b9f6-c2cfbbc269e3 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.450445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:21.451216 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:21.451561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:21.451901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:21.452597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] RBAC: Adding query filter params (type=network) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:21.452969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:21.453687 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 340/667] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:21.466957 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177210ce-5b9f-4cfc-9b78-bd94e4bc329e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:21.478540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 328/668] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:22.804927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee7c85-2fe5-4ea0-9265-076205b3cf86 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:22.805485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee7c85-2fe5-4ea0-9265-076205b3cf86 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:22.805485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee7c85-2fe5-4ea0-9265-076205b3cf86 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:22.806873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 341/669] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:22.812131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6a09-d6c0-499f-b91f-1bbe5d5e3614 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:22.812593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6a09-d6c0-499f-b91f-1bbe5d5e3614 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:22.812746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6a09-d6c0-499f-b91f-1bbe5d5e3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:22.830835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-09ce6a09-d6c0-499f-b91f-1bbe5d5e3614 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:22.832018 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-09ce6a09-d6c0-499f-b91f-1bbe5d5e3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:22.871450 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:22.904518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 329/670] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:23.226351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee7c85-2fe5-4ea0-9265-076205b3cf86 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:23.326311 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:23.350378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee7c85-2fe5-4ea0-9265-076205b3cf86 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:23.353883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247bd7-5aa7-460f-8015-9339d72d9896 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.354416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247bd7-5aa7-460f-8015-9339d72d9896 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.354886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247bd7-5aa7-460f-8015-9339d72d9896 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.356692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 330/671] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:23.362208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.362613 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.363010 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.382030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:23.383369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:23.385292 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:23.386114 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.386529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.386925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.397757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:23.403740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:23.404867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:23.405947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:23.408162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 342/672] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:23.413843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:23.465891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 331/673] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:23.515720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0bc5-c139-40cb-939c-403a87481a3d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:23.551703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:23.552353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.552640 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.552978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.553707 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:23.554018 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:23.555421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06fcaf-6004-4ef8-83ed-b0ec5ab62e8a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:23.565948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:23.571770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:23.680062 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c61003-9bc5-43dc-a463-78bb434c299b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:23.681669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:23.715308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:23.715947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.716226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.716500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.726794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:23.728343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:23.734013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f2d5-1180-4192-8b9e-dc9feb3b8ad7 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.734312 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f2d5-1180-4192-8b9e-dc9feb3b8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.734594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f2d5-1180-4192-8b9e-dc9feb3b8ad7 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.737452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 344/675] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:23.741641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc494f-14f1-4303-9bec-00b0a81d5de4 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.741944 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc494f-14f1-4303-9bec-00b0a81d5de4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.742223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc494f-14f1-4303-9bec-00b0a81d5de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-e2ee845d-f383-4fac-bade-7857be211d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:23.743409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:23.744404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:23.745315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:23.745315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:23.745315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:23.745315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 332/676] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:23.748826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:23.752534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4f7d-0c08-4ad9-b149-ec92b0fcf444 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.752818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4f7d-0c08-4ad9-b149-ec92b0fcf444 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.753089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4f7d-0c08-4ad9-b149-ec92b0fcf444 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.754562 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 333/677] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:23.755132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4f7d-0c08-4ad9-b149-ec92b0fcf444 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:23.763337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-debc494f-14f1-4303-9bec-00b0a81d5de4 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:23.764536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-debc494f-14f1-4303-9bec-00b0a81d5de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:23.836761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 345/678] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 20 20:36:23.838827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.839111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.839382 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.861829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:23.862524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4f7d-0c08-4ad9-b149-ec92b0fcf444 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:23.863073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:23.897293 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:23.898195 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:23.898526 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:23.898747 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:23.899385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:23.899685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:23.901101 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:23.913795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 334/679] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:23.914584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:23.930265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:23.937292 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 346/680] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 20 20:36:23.938013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.000783 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:24.043673 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2908-31ba-4b4a-a0ec-5c5ca0d04c36 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.055064 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4374-6c65-406e-9576-079d2fac075f None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.079708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.080342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.080618 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.080888 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] PATH_INFO: `/v3/users/nova` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.091795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.093180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.103546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.104513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.104995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:24.105374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:24.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:24.107869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:24.108767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.109750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.111405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 347/681] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:24.111721 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.112265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.135614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 335/682] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:23 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:24.158001 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.244075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:24.253774 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce76d-186e-47c3-901b-d76af252920d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.282187 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab7a3-c5fa-43e0-8c96-eef149b80c2b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.284784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:24.298504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.299139 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.299422 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.299703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.300462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:24.300771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.302279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.327249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 348/683] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:24.328254 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.328685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.329371 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.329681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.329959 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.330605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.332630 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.349091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 336/684] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:24 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:24.350708 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.480429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5406b-5d86-4bbf-b5c5-901d772f9fc2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.484475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a7736-d6d5-47db-88cf-29708c5dbfc6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.513667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:24.525021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.525915 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.527160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.527471 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.532028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.532914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.533375 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.533872 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.534698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.536749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.540078 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.542344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.558497 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 349/685] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:24 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:24.561550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:24.562682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:24.563798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:24.563798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:24.563798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:24.569492 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 337/686] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:24.570806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.624732 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:24.701850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f9e7-bcef-4484-a7ef-4eef041bfadd None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.739736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.740542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.740911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.741279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.742069 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:24.742468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.744066 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.757131 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 350/687] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:24.762575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:24.869797 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036fd-1fbd-477b-a3a3-fb24cb3010fa None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:24.905243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:24.906207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:24.906665 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:24.907135 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:24.914328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:24.915986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:24.927606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:24.928521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:24.929421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:24.931484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 338/688] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:24.937290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:25.032276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:25.038672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba25a2-2026-4393-961f-112bab850cc5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:25.072881 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:25.073769 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:25.074194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:25.074617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:25.075450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:25.075923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:25.077550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6645a-a4e9-4405-944b-a8692c853a8c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:25.090606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 351/689] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:25.096626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:25.137799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:25.197507 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733db7-3fba-4769-8074-5fef54e00e2b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:25.232001 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:25.232663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:25.232940 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:25.233212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/551583a3f32e433cae6bbbd33e862ba0/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:25.235314 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=551583a3f32e433cae6bbbd33e862ba0, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:25.236769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8715f5-8e8b-4f7f-90b7-41f8bf702df7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:25.252610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 339/690] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:36:25 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/551583a3f32e433cae6bbbd33e862ba0/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:36:26.419794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a92c8b-c095-42a5-9100-1e4cfa0669e3 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.420788 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a92c8b-c095-42a5-9100-1e4cfa0669e3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.421259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a92c8b-c095-42a5-9100-1e4cfa0669e3 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.423099 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 352/691] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:26.428651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4d04-2044-42d6-88f5-9ab8c9637d0f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.429460 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4d04-2044-42d6-88f5-9ab8c9637d0f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.429975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4d04-2044-42d6-88f5-9ab8c9637d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.449468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d41b4d04-2044-42d6-88f5-9ab8c9637d0f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:26.451150 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d41b4d04-2044-42d6-88f5-9ab8c9637d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:26.527746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 340/692] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:26.613061 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca01f-cd8b-4423-a76b-464cbc403db6 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.613272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca01f-cd8b-4423-a76b-464cbc403db6 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.613540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca01f-cd8b-4423-a76b-464cbc403db6 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.615244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 353/693] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:26.620629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc3af-965e-4df9-bbe0-a8e718dd8901 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.621143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc3af-965e-4df9-bbe0-a8e718dd8901 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.621423 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc3af-965e-4df9-bbe0-a8e718dd8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.640091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-383bc3af-965e-4df9-bbe0-a8e718dd8901 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:26.641321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-383bc3af-965e-4df9-bbe0-a8e718dd8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:26.666736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:26.729554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 341/694] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:26.836525 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c508-84ac-4574-9840-72529850c25b None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.836874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c508-84ac-4574-9840-72529850c25b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.837129 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c508-84ac-4574-9840-72529850c25b None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.839047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 354/695] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:26.844858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:26.845133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:26.845412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:26.868355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:26.869756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:26.873799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c508-84ac-4574-9840-72529850c25b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:26.953329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 342/696] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:26.988986 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c508-84ac-4574-9840-72529850c25b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.022602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.023238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.023513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.023781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.024358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.025816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:27.034454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:27.035435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.036274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 355/697] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Aug 20 20:36:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:27.041765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.056878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.079904 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.140838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.154212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f63d9-4abd-4173-9f2e-04507b007d8c None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.163790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86add3fe-518a-4533-8ae1-18eb9a1c4556 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.190577 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.191198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.191474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.191792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.192431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.192907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.194621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.204415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 343/698] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.205536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.208164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.208817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.209089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.209369 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] PATH_INFO: `/v3/services/network` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.210184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.212841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:27.223682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:27.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:27.225508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 356/699] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:27.230649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.319296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c175-a5e6-4a7f-8f38-a5132599f681 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.349908 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.357136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.357853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.358198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.358661 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.359159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.359464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.360927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.366519 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 344/700] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.367801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006442ea-48e8-4bb6-bf8a-94a2f8ae81bb None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.372117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.392616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.404405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.405142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.405492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.406033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.406472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] RBAC: Adding query filter params (name=network) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.406776 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.408200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.413464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 357/701] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:27.419045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.484118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8694-8fa2-49e6-8876-808b68268d35 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.518686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.519658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.520132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.520612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] PATH_INFO: `/v3/services/image` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.521409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.523213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.525554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c48d-711e-4494-a013-9fe76928d090 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:27.533405 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:27.534600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:27.535657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:27.538133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 345/702] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:27.538915 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.564057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.564676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.564952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.565223 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.565949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] RBAC: Adding query filter params (interface=public, service_id=576c1cbe6a264974b6f181665063fbfa, region_id=RegionOne) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.566255 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.567629 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.575116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 358/703] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/endpoints?service_id=576c1cbe6a264974b6f181665063fbfa&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.575882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.591113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.624439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.647829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e878-1cc7-4a26-80c8-ea8c2dde5e05 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.676757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672f02-6a8a-40be-9528-d8e32789b951 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.680811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.681418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.681750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.682021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.682641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] RBAC: Adding query filter params (type=network) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.682939 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.684321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ea48-fd76-4ed1-ba84-e3db2d33a4fb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.689178 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 346/704] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.690332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56afaf-8caf-44c5-9b1e-397e536ae7c0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.690615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56afaf-8caf-44c5-9b1e-397e536ae7c0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.690913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56afaf-8caf-44c5-9b1e-397e536ae7c0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.692224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 347/705] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:27.692754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56afaf-8caf-44c5-9b1e-397e536ae7c0 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.712748 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.713386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.713696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.713966 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.714592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] RBAC: Adding query filter params (name=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.714894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.716266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.720944 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 359/706] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.721733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.791959 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56afaf-8caf-44c5-9b1e-397e536ae7c0 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.794537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.817083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4bda-68e6-4b1d-9c27-6e35414baad8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:27.825117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.825758 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.826032 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.826300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.826898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.828266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24493d57-e8bc-4e87-b5db-8ab98351c070 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.833823 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 348/707] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services => generated 1002 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:36:27.834799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.835079 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.835348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.854729 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:27.855973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:27.858431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:27.868736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:27.869537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:27.869861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:27.870136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:27.870875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] RBAC: Adding query filter params (interface=public, service_id=697945f7834a4f81b5d0550391cc70fb, region_id=RegionOne) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:27.871159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:27.872573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:27.878354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 360/708] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/endpoints?service_id=697945f7834a4f81b5d0550391cc70fb&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:27.879219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.939679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 349/709] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:27.940557 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:27.987440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21a49-705b-44f8-94e4-d3a3abb12335 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.022921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.023839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.024298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.024752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.025411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] RBAC: Adding query filter params (type=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:28.025788 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.027187 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.032928 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 361/710] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:28.038312 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.046741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:28.060772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb800-cbcf-4e1b-b6aa-808cbe537df6 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.104333 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.105484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.106432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.107119 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.107902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.110343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.118699 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 350/711] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:27 2022] GET /identity/v3/services => generated 1002 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:36:28.160784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764cc9-4420-4764-9230-d7b3ab57e779 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.199360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.199908 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.200186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.200455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.201169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] RBAC: Adding query filter params (interface=public, service_id=07c0eebdaf114b33b817bc493b97c40c, region_id=RegionOne) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:28.201474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.202918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.209445 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 362/712] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/endpoints?service_id=07c0eebdaf114b33b817bc493b97c40c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:28.215380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.218877 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:28.305509 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.341662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158bed1-65f4-40d1-b919-0fd59187c55d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.394223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.394863 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.395143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.395412 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.396011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.397400 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.404126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:28.409788 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 351/713] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/services => generated 1002 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:36:28.444977 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156eacc-3e22-4dde-b9bb-d84c8aee0b02 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.485204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.486305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.486783 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.487283 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.500267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:36:28.506156 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:28.507170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:36:28.508067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:28.510988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 363/714] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:28.520971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.600463 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:28.639597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd48c4-d62e-4ac6-b496-7da35129b90c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.673391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.674042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.674317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.674588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.675254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:28.675583 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.676942 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.685987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 352/715] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:28.691515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.796317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8145c6-4e4a-45e1-a863-a95b79e5e665 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.826374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:28.831436 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:28.832075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:28.832355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:28.832627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:28.845194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:28.846690 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:28.861036 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:28.862064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:28.863663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:28.863663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:28.863663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:28.863663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 364/716] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:28.868022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:28.966222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052fb4-eb70-4685-a528-11a2e40da086 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:28.997231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:29.005575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:29.006222 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:29.006502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:29.006775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:29.007522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:29.008039 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:29.009754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:29.021964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 353/717] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:29.027249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:29.132010 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ca63d-419a-41aa-a8f4-c10498a56224 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:29.167079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:29.167714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:29.167995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:29.168311 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:29.175979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:29.177434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:29.188526 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:29.189468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 20 20:36:29.190461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:29.193966 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 365/718] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Aug 20 20:36:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:29.198800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:29.308998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422c6f-c647-4bc0-b499-497fc9271407 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:29.346574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:29.347194 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:29.347471 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:29.347741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:29.348475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:29.348780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:29.350259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:29.368041 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 354/719] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Aug 20 20:36:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:29.373780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:29.417593 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:29.477951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65be0-f806-405f-af37-9e9971032763 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:29.512987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:29.513967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:29.514453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:29.514951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:29.583786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:29.585602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:29.634285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:29.697953 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 366/720] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:29 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 20 20:36:29.700103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:29.753741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:29.812439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4878b-6b0d-4520-9c30-b3eba69e5306 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:29.851298 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:29.852328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:29.852811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:29.853283 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:29.864417 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:29.866320 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:29.881715 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:29.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:29.883580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:29.883580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:29.883580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:29.886754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 355/721] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:29.892145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:29.996903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7e7d3-bb5b-4b84-86e2-a52052cba855 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:30.031276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:30.031894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.032171 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.032444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.033090 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:30.033388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:30.034788 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e275ef-1fa9-45a8-bb44-0dd90bd1cf2c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:30.044797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:30.046919 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 367/722] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:30.053236 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:30.160982 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:30.164610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139f9c-f015-4789-af45-882ea86d1bf6 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:30.200605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:30.201240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.201522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.201827 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.208811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:30.210439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:30.222682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:30.223614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:30.224503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 356/723] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:30.226528 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e802f-55b5-4c07-b1ef-2a627fa0551d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.226639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e802f-55b5-4c07-b1ef-2a627fa0551d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.226927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e802f-55b5-4c07-b1ef-2a627fa0551d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.228718 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 368/724] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:30.234534 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:30.234971 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.235221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.235496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.256722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:30.258046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:30.349287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 369/725] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:30.374205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441808f2-9e35-444e-bc25-4d38ff8b31f2 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:30.409274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:30.410286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.410781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.411282 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.412209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:30.412705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:30.414376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e11d4-4b5d-41e1-a7ab-52bda715b5eb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:30.427730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 357/726] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:30.434073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:30.482586 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7bf80-2f42-42eb-95f8-92c4c360b985 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.482918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7bf80-2f42-42eb-95f8-92c4c360b985 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.483145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7bf80-2f42-42eb-95f8-92c4c360b985 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.484752 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 358/727] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:30.490782 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930abfa4-eeec-4b3d-a322-eb23506c8f11 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.491079 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930abfa4-eeec-4b3d-a322-eb23506c8f11 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.491457 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930abfa4-eeec-4b3d-a322-eb23506c8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.517680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-930abfa4-eeec-4b3d-a322-eb23506c8f11 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:30.518965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-930abfa4-eeec-4b3d-a322-eb23506c8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:30.538029 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:30.561983 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4831-4d63-4d89-8eb2-205f67d8df43 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:30.599730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:30.607621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:30.608668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.609117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.609689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.610757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=551583a3f32e433cae6bbbd33e862ba0) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:30.611327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:30.613297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d37aa5-e59e-4765-8ffc-42ef8e03f733 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:30.620923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 370/728] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:36:30 2022] GET /identity/v3/role_assignments?user.id=551583a3f32e433cae6bbbd33e862ba0&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:30.687416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6684-d18a-4322-86ea-3a6deaa6a95c None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.687757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6684-d18a-4322-86ea-3a6deaa6a95c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.687982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6684-d18a-4322-86ea-3a6deaa6a95c None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.689772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 371/729] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:30.690628 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6684-d18a-4322-86ea-3a6deaa6a95c None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:30.737854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 359/730] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:30.737854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.737854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.737854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.752824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:30.755244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:30.830469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6684-d18a-4322-86ea-3a6deaa6a95c None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:30.851567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 360/731] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:30.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:30.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:30.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:30.871468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:30.872038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:30.873453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:30.882613 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:30.883614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:30.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 372/732] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Aug 20 20:36:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:30.889713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:30.973599 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:30.995842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab91d0b-e8d7-4d87-baa8-ed5750ddd5b3 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.030170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.030834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.031112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.031378 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.032004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.032304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.033703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.038540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 361/733] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:31.043901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.061743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.112049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.165201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d2a-39f7-4ca9-84b6-49397f314f45 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.172304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6b695-dd01-4864-a01a-3989b768d524 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.207018 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.207658 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.207929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.208047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.208222 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.208568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.209044 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.209144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.209216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.209790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] PATH_INFO: `/v3/services/network` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.210415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.210508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.212129 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.216041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 373/734] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:31.216829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:31.221594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:31.222611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:31.223455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 362/735] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:31.224255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.232300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.329023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d7cb-9002-4410-94a8-b6fe0cf96fea None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.337367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4384-5a02-4f86-9006-823d8f4e2d61 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.363641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.364180 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.364461 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.364733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.365198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.365400 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.366847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.378149 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.379265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.379583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.380205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] PATH_INFO: `/v3/services/image` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.380974 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.382746 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.397642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 363/736] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:31.397642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:31.397934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:31.399086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:31.400163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 374/737] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:31.401198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.498537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.533361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58be34-54ea-45e7-a868-3c27fd24fbbb None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.568669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b245-8c02-4a5c-8141-6b1deda4d55a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.573865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.574620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.575001 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.576639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.576639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.576639 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.578980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.584543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 375/738] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:31.590680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.617235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.617833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.618118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.618393 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.619031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] RBAC: Adding query filter params (name=network) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.619425 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.620992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.627124 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 364/739] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:31.632260 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.651195 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.721709 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d5e4-f158-4e4b-afb0-92b02d7677f3 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.757197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfe53c-ca26-4a2b-b765-9534a23ecb18 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.762665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.763431 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.763829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.764208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.764917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] RBAC: Adding query filter params (type=image) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.765288 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.766782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.772296 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 376/740] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:31.778050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.783718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.798546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.799334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.799614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.800180 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.800819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] RBAC: Adding query filter params (type=network) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:31.801121 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.802535 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.810017 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 365/741] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:31.815269 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:31.906433 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d09d-7fe2-4e8d-92b4-9a14d0626db2 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.922264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:31.943167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2ef5-fede-4589-976b-4e2e461ddedc None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:31.946312 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.947180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.947683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.948143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.949045 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.950740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63526ae-0d38-4690-a538-3cd712f6e21a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:31.978126 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 377/742] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:36:31.990440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:31.991438 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:31.991932 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:31.992394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:31.993363 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:31.995214 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c16a-ae37-4d57-af38-81b55bf2193e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:32.022567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 366/743] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:36:32.900168 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea4e7-4b47-4924-a5d4-b08c8f1ecb17 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:32.900462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea4e7-4b47-4924-a5d4-b08c8f1ecb17 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:32.900753 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea4e7-4b47-4924-a5d4-b08c8f1ecb17 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:32.902093 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 378/744] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:32.907803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:32.908278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:32.908355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:32.926559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:32.927745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:32.959010 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:33.006869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 367/745] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:33.324508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bea4e7-4b47-4924-a5d4-b08c8f1ecb17 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:33.559441 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bea4e7-4b47-4924-a5d4-b08c8f1ecb17 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:33.594463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:33.595019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:33.595297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:33.595567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:33.596155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:33.597532 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3a85ddae-ef1c-496e-935c-8080323b6e99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:33.606342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:33.607430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:33.608449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 379/746] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Aug 20 20:36:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:33.613514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:33.670062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3001d10-e868-4ecb-8ff0-2d356421e8b5 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:33.670389 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3001d10-e868-4ecb-8ff0-2d356421e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:33.670612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3001d10-e868-4ecb-8ff0-2d356421e8b5 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:33.672085 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 380/747] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:33.677000 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:33.677289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:33.677560 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:33.696884 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:33.698224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:33.719254 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd351f64-5fd0-45b7-9b0d-bab71e80b414 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:33.725243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:33.754956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:33.755573 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:33.755851 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:33.756127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:33.756755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:33.757059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:33.758486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:33.763095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 368/748] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:33.768685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:33.776209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 381/749] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:33 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:33.797503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:33.875236 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20bd2-d7b6-4e2a-91cc-e2c0a7f6ba5e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:33.910737 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:33.911362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:33.911592 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:33.911887 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:33.912514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:33.912817 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:33.914240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775033-387e-45c7-a657-fbbc7efe3872 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:33.919244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 369/750] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:34.101275 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:34.175753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6f01-962f-4253-a4c0-0bea63da8bf2 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.176322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6f01-962f-4253-a4c0-0bea63da8bf2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.176735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6f01-962f-4253-a4c0-0bea63da8bf2 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.178224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 370/751] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:34.183447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.183798 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.184156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.201875 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:34.203070 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:34.211101 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b78dd-865f-4f83-a313-15df5b8cb0ce None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:34.248892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:34.249510 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.249874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.250137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.250649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:34.252134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:34.262691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:34.263701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:34.264948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 382/752] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:34.270226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:34.276118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 371/753] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:34 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:34.299580 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:34.377950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f98a1-abf9-4fa9-a9d1-661d261f3cc1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:34.415325 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:34.415938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.416279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.416550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.417177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:34.417476 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:34.418874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:34.428490 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 383/754] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:34.429775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:34.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:34.532661 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51ca7c-12b4-4966-846b-87e3b03be5a8 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:34.572369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:34.573356 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.573859 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.574321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.575138 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:34.575688 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:34.577261 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:34.582203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 372/755] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:34.594154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:34.694929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:34.705728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58d91-e97d-410a-9d83-09910c2b8b82 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:34.742750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:34.743374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:34.743645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:34.743909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:34.817688 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:34.819161 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:34.912277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:34.923995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 384/756] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:36:34 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 20 20:36:34.929537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:35.019091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:35.037394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a01a4-e394-45be-bb4f-dacb46189286 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:35.073105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:35.073770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:35.074045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:35.074316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:35.084459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:35.085950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-90d8881b-16b4-44d7-8dec-4c90520528ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:36:35.100291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:35.101242 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:36:35.102192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:36:35.102192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:36:35.102192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:35.102192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 373/757] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:35.109164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:35.206767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c771d-4023-476f-8403-9fae5553edc5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:35.240513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:35.241136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:35.241413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:35.241781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:35.242428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:35.242733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:35.244110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bb81a-f8df-4aae-8772-56634efbdfe2 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:35.255578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 385/758] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:36.107824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3cf9-066f-4586-b999-8570723c2092 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:36.108415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3cf9-066f-4586-b999-8570723c2092 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:36.108415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3cf9-066f-4586-b999-8570723c2092 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:36.109867 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 374/759] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:36.114987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c5b5-d151-4f87-a3bf-df39c20784d3 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:36.115406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c5b5-d151-4f87-a3bf-df39c20784d3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:36.115540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c5b5-d151-4f87-a3bf-df39c20784d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:36.134441 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7587c5b5-d151-4f87-a3bf-df39c20784d3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:36.135698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7587c5b5-d151-4f87-a3bf-df39c20784d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:36.187406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:36.208313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 386/760] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:36 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:36.524847 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd3cf9-066f-4586-b999-8570723c2092 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:36.633606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd3cf9-066f-4586-b999-8570723c2092 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:36.667495 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:36.668092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:36.668368 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:36.668636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:36.669268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:36.670676 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb1a4-1ec5-4453-a6fd-78eaa2dae5da None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:36.680502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:36.694221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 375/761] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:36 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:36.735917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8aa5c-c42f-4972-bf48-8772202d423d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:36.736173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8aa5c-c42f-4972-bf48-8772202d423d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:36.736446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8aa5c-c42f-4972-bf48-8772202d423d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:36.737865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 387/762] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:36.744056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880b98-ea5b-4a27-83f6-7fb1ea083056 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:36.744384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880b98-ea5b-4a27-83f6-7fb1ea083056 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:36.744663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880b98-ea5b-4a27-83f6-7fb1ea083056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:36.764167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-b1880b98-ea5b-4a27-83f6-7fb1ea083056 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:36.765388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-b1880b98-ea5b-4a27-83f6-7fb1ea083056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:36.845552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 376/763] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:36 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:37.195458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8aa5c-c42f-4972-bf48-8772202d423d None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:37.298668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8aa5c-c42f-4972-bf48-8772202d423d None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:37.339643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:37.340286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:37.340571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:37.340846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:37.341499 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:37.342935 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec85885-ba2d-4d81-a090-83bbf34bfc19 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:37.359988 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 388/764] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:37 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:38.842569 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619983-0403-409f-9397-e0f185ab8c2e None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:38.843125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619983-0403-409f-9397-e0f185ab8c2e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:38.843125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619983-0403-409f-9397-e0f185ab8c2e None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:38.844444 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 377/765] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:38.850078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:38.850460 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:38.850635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:38.869812 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:38.871003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:38.906178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:38.943765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 389/766] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:39.262754 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619983-0403-409f-9397-e0f185ab8c2e None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.386552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619983-0403-409f-9397-e0f185ab8c2e None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:39.416681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:39.429589 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:39.430265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.430544 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.430816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.431383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:39.432839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-3222606f-5996-41c3-bb5c-8637d7d2345e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:39.441487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:39.442593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:39.443484 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 378/767] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:39.448715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.512240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75fa5-8dda-4e34-bd96-73496bc0bd52 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.512522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75fa5-8dda-4e34-bd96-73496bc0bd52 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.512864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75fa5-8dda-4e34-bd96-73496bc0bd52 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.514176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 379/768] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:39.519325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.519890 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.538112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:39.539291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:39.552459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a219-afa4-419b-84f3-86af62b7956f None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:39.588708 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:39.589323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.589606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.589910 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.590553 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:39.590857 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:39.592242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:39.596903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 390/769] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:39.602619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.608095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 380/770] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:36:39.631933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:39.700140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a280-a989-4857-ad8b-ee325b2c597c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:39.736237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:39.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.737124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.737395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.738060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:39.738360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:39.739739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:39.744808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 391/771] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:39.750852 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.849043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2995b-0e16-45b0-a1a0-464f51c7d785 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:39.865998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:39.883093 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:39.883705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:39.883986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:39.884255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:39.885006 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] RBAC: Adding query filter params (interface=public, service_id=9ecfefd7ce17402b8d02127d0439658e, region_id=RegionOne) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:39.885314 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:39.886743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:39.893941 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 381/772] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/endpoints?service_id=9ecfefd7ce17402b8d02127d0439658e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:39.899782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.927172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:39.993938 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:40.001147 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c93a50-3efd-44d3-8bdc-4ef720ffd2e1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.025111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a229-3094-41a9-a440-467c59008acb None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.034612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.035218 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.035498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.035771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.036374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.037793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.043638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 392/773] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:36:40.058613 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.059285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.059568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.059844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.060442 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.061905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:40.071631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:40.072794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:40.073848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 382/774] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:36:40.079230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:40.187438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46154d2d-a59e-4cc3-a442-01e18171ade4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.225128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.226475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.226475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.226475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.226914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:40.227210 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.228899 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.233396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 393/775] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:40.240566 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:40.287142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:40.343545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1481f-e858-4f0c-af1c-df3e8f4b5e6a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.377911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.378524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.378802 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.379075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.379695 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:40.379995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.381410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.386569 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 383/776] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:40.392640 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:40.417559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:40.495300 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa4e8-f6e5-4a2b-8c5d-2566457a4e86 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.544907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.545537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.545849 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.546127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.546836 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] RBAC: Adding query filter params (interface=public, service_id=733347bdfee4421ba8d51a7303ad7033, region_id=RegionOne) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:40.547148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.548538 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cef4-6539-4db4-9253-2ca9d9a7468b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.558378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 394/777] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:40 2022] GET /identity/v3/endpoints?service_id=733347bdfee4421ba8d51a7303ad7033&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:40.559654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:40.672816 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870c69b-3a07-41e8-9b71-00c3a9a421ae None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:40.682893 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:40.706563 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:40.707181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:40.707463 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:40.707741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:40.708346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:40.709740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b096-99a0-4f08-b547-18ecee64e7de None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:40.716007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 384/778] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:40 2022] GET /identity/v3/services => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:36:42.195821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40c42-a1f4-4fc8-aa88-8b76c2748125 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.196408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40c42-a1f4-4fc8-aa88-8b76c2748125 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.196408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40c42-a1f4-4fc8-aa88-8b76c2748125 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.197735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 395/779] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:42.203126 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.203518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.203703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.222807 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:42.223992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:42.291818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 385/780] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:42 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:42.609550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40c42-a1f4-4fc8-aa88-8b76c2748125 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:42.701205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:42.717739 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40c42-a1f4-4fc8-aa88-8b76c2748125 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:42.753994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:42.754620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.754895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.755163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.755743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:42.757159 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-911fcf07-e6d9-48d1-831e-a350e295b735 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:42.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:42.767483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 20 20:36:42.768519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:42.769811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 396/781] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Aug 20 20:36:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:42.773483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:42.854047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fc29-c418-4014-a3ef-a98af03c53f2 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.854317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fc29-c418-4014-a3ef-a98af03c53f2 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.854630 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fc29-c418-4014-a3ef-a98af03c53f2 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.855955 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 397/782] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:42.860995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.861219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.861496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.872147 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79661f7d-3aca-4a42-8d15-014384a88347 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:42.874458 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:42.880558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:42.881805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:42.909815 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:42.910641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:42.910941 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:42.911205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:42.911840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:42.912143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:42.913530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:42.918153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 386/783] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:42.923698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:42.946434 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 398/784] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:42 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:36:43.016396 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597bc8-32a3-47bc-b7fd-676bae3d0519 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.051547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.052139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.052411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.052675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.053291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:43.053588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.054987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.059897 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 387/785] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Aug 20 20:36:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:43.065754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:43.147811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:43.167366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7339e8f-ba7f-4154-9ce1-0de82dfbc19b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.215915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.216555 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.216793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.217059 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.217756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.219142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.239321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 399/786] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:36:43.262445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:43.297062 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:43.373339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bb694-e5d5-46bb-90fd-67a1ad62682a None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.417241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.417820 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.418102 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.418376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.418980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.420368 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:43.429600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:43.430658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:43.431496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 388/787] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:43.437810 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:43.537948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483374b-b391-4293-8acd-33c494b8c6c6 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.571482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.572089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.572427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.572714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.573335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:43.573658 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.575031 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.579817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 400/788] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:43.585486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:43.680911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:43.690276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d923f4-ffec-4bed-b8c7-7f3b9437511e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.724778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.725390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.725665 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.725972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.726598 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:43.726905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.728324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09867d25-f16b-4939-8022-d4d60b3d1836 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.733056 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 389/789] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Aug 20 20:36:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:43.738926 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:43.741870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:43.845642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa282-eaeb-47cd-b47e-489e00be6163 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:43.880451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:43.881057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:43.881361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:43.881658 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:43.882468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:43.883867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9669-2e96-4c71-8053-c5f4f4e791d9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:43.904771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 401/790] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:36:45.418114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef645-9427-48ea-97f5-f0628619da8d None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:45.418685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef645-9427-48ea-97f5-f0628619da8d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:45.418685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef645-9427-48ea-97f5-f0628619da8d None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:45.420030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 390/791] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:45.425662 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:45.426064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:45.426249 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:45.445041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:45.446261 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:45.502186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:45.525450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 402/792] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:45 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:45.841897 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef645-9427-48ea-97f5-f0628619da8d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:45.949594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef645-9427-48ea-97f5-f0628619da8d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:45.986116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:45.986745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:45.987023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:45.987295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:45.987860 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:45.989235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-ba88ca63-76c1-43af-b7c0-c5c6c8452334 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:45.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:45.999107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:46.000505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 391/793] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:46.005241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:46.051472 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc7861-1710-4a34-9cde-9d08abde7f81 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.051711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc7861-1710-4a34-9cde-9d08abde7f81 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.052011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc7861-1710-4a34-9cde-9d08abde7f81 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.053310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 392/794] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:36:46.058198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.058477 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.058753 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.076911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:46.078166 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:46.092792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:46.104893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91cfc0-617d-4c66-8cc1-d511da7a8997 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:46.138574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:46.139206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.139477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.139743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.140367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:46.140668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:46.142082 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:46.145154 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 393/795] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:36:46.146602 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 403/796] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:46.153152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:46.248903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d82f-2d0e-41bd-9c2c-e92357865f97 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:46.283466 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:46.284059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.284335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.284590 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.285204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:46.285504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:46.286915 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:46.291348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 394/797] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:36:46.465202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:46.515668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:46.566738 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba142b0-7f71-4bad-a668-e3481b8a57fd None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:46.601372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:46.602023 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.602298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.602569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.603213 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:46.604786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:46.607404 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING keystone.server.flask.common [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 20 20:36:46.625439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.sql.core [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 20 20:36:46.625439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 20 20:36:46.625439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [parameters: {'id': '930c98125e3148128e5a9cca2afb2112', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 20 20:36:46.625439 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94925) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 930c98125e3148128e5a9cca2afb2112.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 930c98125e3148128e5a9cca2afb2112. Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result = self._query(query) Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application conn.query(q) Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 20 20:36:46.642153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result.read() Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 20 20:36:46.643067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application next(self.gen) Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application yield resource Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application next(self.gen) Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.session.rollback() Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.force_reraise() Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise self.value Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application session.commit() Aug 20 20:36:46.644680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._prepare_impl() Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.session.flush() Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._flush(objects) Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application compat.raise_( Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application flush_context.execute() Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 20 20:36:46.645660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rec.execute(self) Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 20 20:36:46.646633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result = self._query(query) Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application conn.query(q) Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result.read() Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 20 20:36:46.647491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [parameters: {'id': '930c98125e3148128e5a9cca2afb2112', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:46.649830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:46.651517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 930c98125e3148128e5a9cca2afb2112. Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:46.653514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 404/798] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Aug 20 20:36:46 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:46.654228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:46.665607 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:46.750117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd96f89-398d-42bc-a999-7bc319512539 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:46.784074 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:46.784705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.784989 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.785258 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.791994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:46.793455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-558dd252-c8c2-4dae-b413-ea0a389e1b86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:36:46.804447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:46.805399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:46.811307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 395/799] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:46.811825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:46.913961 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ab744-b2b3-4ac5-86cb-65901114ac79 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:46.916454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:46.949028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:46.949673 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:46.949952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:46.950224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:46.950888 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:46.951190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:46.952830 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdfc22-7620-4fc4-b8bd-ee996cc12ed7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:46.972503 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 405/800] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:48.432318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dce2-d3f0-49c9-916a-151bb74997ee None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:48.432843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dce2-d3f0-49c9-916a-151bb74997ee None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:48.432955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dce2-d3f0-49c9-916a-151bb74997ee None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:48.434390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 396/801] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:48.440019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6463-9499-47aa-8575-83e9672b9ef1 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:48.440420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6463-9499-47aa-8575-83e9672b9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:48.440571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6463-9499-47aa-8575-83e9672b9ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:48.460199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-c5ab6463-9499-47aa-8575-83e9672b9ef1 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:48.462062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-c5ab6463-9499-47aa-8575-83e9672b9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:48.533219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 406/802] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:48 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:48.850838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5dce2-d3f0-49c9-916a-151bb74997ee None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:48.927436 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:48.952546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5dce2-d3f0-49c9-916a-151bb74997ee None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:48.986110 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:48.986744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:48.987001 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:48.987290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:48.987964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:48.989383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471809f-8fe8-4890-be92-feec9c5bd2ab None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:49.006169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 397/803] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:36:48 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:36:49.155260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898559b-6d54-4cb1-9992-47ed96b35b36 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:49.155493 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898559b-6d54-4cb1-9992-47ed96b35b36 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:49.155683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898559b-6d54-4cb1-9992-47ed96b35b36 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:49.157076 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 407/804] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:49.163102 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:49.163360 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:49.163664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:49.183466 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:49.184710 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:49.258162 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 398/805] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:49 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:36:49.576978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898559b-6d54-4cb1-9992-47ed96b35b36 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:49.674654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:49.683248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898559b-6d54-4cb1-9992-47ed96b35b36 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:49.717063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:49.717694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:49.717972 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:49.718253 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:49.718883 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:49.720329 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:49.734700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.sql.core [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 20 20:36:49.734700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 20 20:36:49.734700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [parameters: {'user_id': '822c364f5cc24c648c0d7d66cb2e830a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 20 20:36:49.734700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94925) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result = self._query(query) Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application conn.query(q) Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result.read() Aug 20 20:36:49.741517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 20 20:36:49.742379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application next(self.gen) Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application yield resource Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application next(self.gen) Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.session.rollback() Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.force_reraise() Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise self.value Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application session.commit() Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 20 20:36:49.743392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._prepare_impl() Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.session.flush() Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._flush(objects) Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application compat.raise_( Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application flush_context.execute() Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rec.execute(self) Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 20 20:36:49.744337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 20 20:36:49.745246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result = self._query(query) Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application conn.query(q) Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application result.read() Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 20 20:36:49.746145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [parameters: {'user_id': '822c364f5cc24c648c0d7d66cb2e830a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:49.746990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 20 20:36:49.747773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:49.748716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 408/806] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Aug 20 20:36:49 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:49.749104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:49.807904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:49.851698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d303-7f08-4d85-8565-6c5bb27ede9a None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:49.887042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:49.887659 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:49.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:49.888201 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:49.895459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:49.896906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-f02f4460-eb06-4865-b4b4-26ec5ab6c639 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:36:49.908530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:49.909560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:49.915925 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 399/807] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:36:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:49.916741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:50.023408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576214e-7053-4d2a-a75b-88b87a440cc4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:50.057577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:50.058286 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:50.058565 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:50.058833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:50.059531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:50.059828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:50.061461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef99-7a59-48b2-8935-74bbbceced89 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:50.101015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 409/808] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Aug 20 20:36:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:51.142603 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a557-b5a8-410a-981d-d7f7d1d1d2f7 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:51.143190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a557-b5a8-410a-981d-d7f7d1d1d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:51.143190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a557-b5a8-410a-981d-d7f7d1d1d2f7 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:51.145225 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 400/809] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:51.154376 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:51.154782 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:51.155002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:51.178871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:51.180394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:51.190204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:51.255060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 410/810] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:36:51.585071 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a557-b5a8-410a-981d-d7f7d1d1d2f7 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:51.694344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a557-b5a8-410a-981d-d7f7d1d1d2f7 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:51.713937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:51.734058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:51.734718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:51.735014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:51.735278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:51.735853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:51.737273 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:51.746532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:51.747680 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:36:51.748679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 401/811] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:51.753771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:51.856416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1253-9ae4-44cb-8032-54a5bb5783fc None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:51.892721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:51.893326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:51.893606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:51.893906 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:51.894532 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:51.894836 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:51.896221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:51.901313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 411/812] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:51.907801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:52.019240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b53a-9eb3-4f2d-a3e2-ea01f9e116b5 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:52.057637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:52.058245 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:52.058522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:52.058793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:52.059413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:52.059717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:52.061103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:52.066486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 402/813] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:52.072651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:52.084675 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:52.177491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ce3a-69b6-42b4-a565-42cf025fcfc1 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:52.212508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:52.213162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:52.213436 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:52.213734 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] PATH_INFO: `/v3/endpoints` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:52.214430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] RBAC: Adding query filter params (interface=public, service_id=85adedec11fe4ae183285fcb055cef66, region_id=RegionOne) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:52.214735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:52.216113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a6172-67d0-4842-9706-08bc3e80364a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:52.221172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 412/814] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:36:52 2022] GET /identity/v3/endpoints?service_id=85adedec11fe4ae183285fcb055cef66&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:52.226920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:52.279594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:52.341840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba5a7-bf97-491b-9e60-9871603779b4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:52.379169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:52.379767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:52.380043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:52.380313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:52.380908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:52.382323 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc50d-a1ea-4371-b248-d229852bf106 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:52.388599 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 403/815] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:36:52 2022] GET /identity/v3/services => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:36:54.528564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047f34-0d26-40b7-9f0c-76919654b347 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:54.529111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047f34-0d26-40b7-9f0c-76919654b347 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:54.529111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047f34-0d26-40b7-9f0c-76919654b347 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:54.531230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 413/816] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:36:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:36:54.539312 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:54.539752 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:54.539840 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:54.561332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:36:54.562620 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:36:54.632844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 404/817] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:36:54.954500 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047f34-0d26-40b7-9f0c-76919654b347 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:55.032051 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:55.063494 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047f34-0d26-40b7-9f0c-76919654b347 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:55.100466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:55.101095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:55.101374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:55.101638 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] PATH_INFO: `/v3/services/compute` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:55.102256 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:55.103648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:36:55.112464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:36:55.113558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:36:55.114567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 414/818] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:36:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:36:55.120082 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:55.165650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:55.226329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffc3cd-b1e3-4373-bbc4-132ba3f9a8d6 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:55.262352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:55.262966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:55.263428 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:55.263693 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:55.264323 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:55.264618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:55.266027 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:55.271790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 405/819] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:55.281874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:55.393880 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76af9-4624-4b71-a9c9-bfede19d8fdd None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:55.435180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:55.436116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:55.436537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:55.436959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:55.437999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] RBAC: Adding query filter params (type=compute) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:36:55.438474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:55.440664 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d33a-d295-4eb5-8c89-b80d536c457b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:55.444046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:55.448874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 415/820] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Aug 20 20:36:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:36:55.455168 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:36:55.564046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57fe5-4852-4352-b04c-177304e2f1e0 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:36:55.571657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:36:55.602966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:36:55.603648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:36:55.603978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:36:55.604258 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:36:55.604926 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:36:55.606336 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91942c9-1d62-4ee7-ba2c-ce7e7a50bb6d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:36:55.632494 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 406/821] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:36:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:37:05.625057 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=18,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:37:57.312770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f6bf-6662-4039-9e79-b4a47ad8d37f None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:37:57.313354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f6bf-6662-4039-9e79-b4a47ad8d37f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:37:57.313354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f6bf-6662-4039-9e79-b4a47ad8d37f None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:37:57.315123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 416/822] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:37:57.320452 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:37:57.320950 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:37:57.321046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:37:57.341061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:37:57.342348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:37:57.425440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 407/823] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:37:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:37:57.757228 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f6bf-6662-4039-9e79-b4a47ad8d37f None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:37:57.894313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f6bf-6662-4039-9e79-b4a47ad8d37f None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:37:57.933295 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:37:57.933958 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:37:57.934265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:37:57.934533 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:37:57.946636 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:37:57.950053 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:37:57.966491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:37:57.967725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:37:57.968851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:37:57.968851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:37:57.968851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:37:57.968851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 417/824] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:37:57.973986 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:37:58.080833 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e46c6-c248-4ef4-872c-1989a675d832 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:37:58.109244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:37:58.119063 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:37:58.119677 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:37:58.119960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:37:58.120256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:37:58.120869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:37:58.121172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:37:58.122600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37627db4-48b3-4cb2-93db-04f097679ebc None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:37:58.135853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 408/825] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:37:58.141909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:37:58.205467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:37:58.257319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c5e3-5a4b-4eaa-83df-c58317ff989d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:37:58.294194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:37:58.295178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:37:58.295688 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:37:58.296038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:37:58.296728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:37:58.298598 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223198d5-f60e-4a92-9206-3811778f5b40 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:37:58.325650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 418/826] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Aug 20 20:37:58 2022] POST /identity/v3/users => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:38:00.611466 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ae58-0f26-46ec-b980-46e9f652f08a None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:00.611993 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ae58-0f26-46ec-b980-46e9f652f08a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:00.611993 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ae58-0f26-46ec-b980-46e9f652f08a None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:00.613375 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 409/827] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:00.619349 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:00.619757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:00.619898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:00.638698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:00.639966 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:00.710213 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 419/828] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:01.039607 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827ae58-0f26-46ec-b980-46e9f652f08a None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:01.157382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827ae58-0f26-46ec-b980-46e9f652f08a None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:01.194821 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:01.195483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:01.195750 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:01.196024 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:01.207759 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:01.212483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:01.213930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:01.214855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 410/829] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:01.220438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:01.264020 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:01.332771 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc735-8729-413e-b1a0-f8550d38ad1c None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:01.372691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:01.373354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:01.373683 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:01.373947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:01.374772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:01.376468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:01.385853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 420/830] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:01.391905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:01.439994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:01.497517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20a9f-39bf-4899-81c6-273845965b5e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:01.533149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:01.533884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:01.534179 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:01.534452 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:01.546275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:01.548004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:01.563326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:01.565510 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:01.566542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:01.566542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:01.566542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:01.566542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 411/831] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:01.570531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:01.683640 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:01.686927 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbbca-d01d-4903-9c73-67fb525ae2c8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:01.726502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:01.727428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:01.727818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:01.728282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:01.729190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:01.729554 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:01.731720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:01.746973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 421/832] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:01.752785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:01.855489 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:01.859818 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa793-8bf3-4277-ae8e-cb4fff433eab None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:01.895145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:01.896096 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:01.896350 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:01.896630 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:01.905480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:01.906975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:01.917910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:01.918935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:01.919945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 412/833] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:01.925102 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:02.026012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69e4c-f9e9-4120-b97b-fb5525e4bed8 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:02.059060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:02.059703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:02.059994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:02.060255 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:02.060980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:02.061285 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:02.062829 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:02.080471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 422/834] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:02.086265 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:02.192407 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9aa5-fe64-49ba-b8b4-3625ff17d135 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:02.237973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:02.238608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:02.238982 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:02.239244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:02.266426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:02.310243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:02.311707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:02.421332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 413/835] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:38:02 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 20 20:38:02.422853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:02.442343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:02.534380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19944c-1bc0-4f5f-9e9d-3d7663319451 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:02.568378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391057a-6290-4384-999c-3524910fb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:02.568987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391057a-6290-4384-999c-3524910fb11d None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:02.569268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391057a-6290-4384-999c-3524910fb11d None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:02.569542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391057a-6290-4384-999c-3524910fb11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:02.580196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391057a-6290-4384-999c-3524910fb11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:02.581786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391057a-6290-4384-999c-3524910fb11d None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-e391057a-6290-4384-999c-3524910fb11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:02.596801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:02.597900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:02.599221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:02.599221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:02.599221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:02.599221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 423/836] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:02.605153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:02.663864 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:02.709354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3b68-107e-403e-803a-13331896013e None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:02.746940 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:02.747566 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:02.747829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:02.748137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:02.748881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:02.749232 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:02.750932 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:02.762297 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 414/837] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:02.768495 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391057a-6290-4384-999c-3524910fb11d None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:02.842098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:02.876827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391057a-6290-4384-999c-3524910fb11d None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:02.911483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:02.912272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:02.912552 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:02.912827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:02.919917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:02.921420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:02.933041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:02.934501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:02.935915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 424/838] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:38:02.940271 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:03.051061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839298-8efb-4f62-af0a-0c9154226fc4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:03.069639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:03.088544 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:03.089212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:03.089433 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:03.089779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:03.090469 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:03.090814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:03.092344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01bde0-e5d8-4254-ab18-3ac319bfca7f None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:03.104897 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 415/839] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:03.110964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:03.222608 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c88e-16ee-4cb7-aa92-89d2241aa923 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:03.254691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:03.262158 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:03.262840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:03.263143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:03.263474 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:03.264335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed027c48f80c43ed82731961fa46e5e7) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:03.264710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:03.266417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0698e6-7806-4379-baf5-5101dbb01976 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:03.272871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 425/840] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:38:03 2022] GET /identity/v3/role_assignments?user.id=ed027c48f80c43ed82731961fa46e5e7&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:05.461815 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cefb9-f7d0-473f-99d9-67affc924d70 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:05.462444 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cefb9-f7d0-473f-99d9-67affc924d70 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:05.462444 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cefb9-f7d0-473f-99d9-67affc924d70 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:05.464079 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 416/841] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:05.469315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:05.469759 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:05.469929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:05.488541 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:05.489775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:05.563252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 426/842] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:05.880465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cefb9-f7d0-473f-99d9-67affc924d70 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.000994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cefb9-f7d0-473f-99d9-67affc924d70 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.042102 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.042740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.043013 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.043285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.055050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:06.060714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:06.061945 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:06.062944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 417/843] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:06.068078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.178121 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55efd53-a68d-426f-a58e-1479ead9ea1c None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.202730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:06.214540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.215447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.215767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.216083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.216931 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] RBAC: Adding query filter params (name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:06.217282 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:06.218814 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:06.228557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 427/844] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:06.234221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.276880 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:06.343236 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bb29-9ad3-46d7-94ca-f8d94e314626 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.380174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.380936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.381348 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.381703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.393982 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:06.395714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:06.411196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:06.412315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:06.413777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:06.413777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:06.413777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:06.413777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 418/845] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:06.418302 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.530316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c96a3-9c89-4b1f-b528-a357c89bfe25 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.567468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.568084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.568426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.568679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.569322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:06.569647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:06.571030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:06.583772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 428/846] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:06.590191 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.691889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:06.703229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089e2f5-6581-4adf-911b-adb0eb349c02 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.739164 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.739800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.740081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.740354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.749401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:06.750911 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:06.763629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:06.764669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:06.765850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 419/847] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:06.770920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:06.828890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:06.900948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffff2-cdeb-4d46-a1fe-b5acd42d1a9e None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:06.942804 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:06.943402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:06.943686 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:06.943948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:06.944674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:06.944975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:06.946450 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:06.968163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 429/848] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:06.973994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:07.084517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160d4b-649a-43ac-838f-0bcfc6505b07 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:07.121733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:07.122361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:07.122640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:07.122906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:07.133455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:07.134966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:07.149084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:07.150366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:07.151767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:07.151767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:07.151767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:07.151767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 420/849] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:07.156406 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:07.268312 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38b8b-da4a-428a-b916-a759b29b5d39 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:07.271061 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:07.306766 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:07.307381 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:07.307654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:07.307923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:07.308561 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:07.308857 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:07.310316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:07.322653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 430/850] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:07.327888 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:07.330848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:07.437640 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5c03-a337-4c84-b433-440f80e81146 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:07.474004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:07.474638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:07.474918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:07.475184 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:07.482650 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:07.484144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:07.496160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:07.497213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:07.498161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 421/851] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:07.503281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:07.610272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7404f-f444-4118-a155-d8e1a53e47b5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:07.650948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:07.651599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:07.651883 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:07.652206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:07.652918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:07.653270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:07.654851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a9e3-f302-4cec-ac34-184bfbff1729 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:07.668281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 431/852] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:07.674761 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:07.739080 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:07.782063 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbffc5d-61a5-4275-a635-7ea307a7bcc4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:07.818207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:07.818881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:07.819159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:07.819431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed027c48f80c43ed82731961fa46e5e7/roles/adcba7f4047a4bf1830c13e93ea560d5` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:07.834874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=ed027c48f80c43ed82731961fa46e5e7, role_id=adcba7f4047a4bf1830c13e93ea560d5)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:07.836418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01e3c-f76c-4680-99ef-5675fc0fa9fb None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:07.851575 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 422/853] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:38:07 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed027c48f80c43ed82731961fa46e5e7/roles/adcba7f4047a4bf1830c13e93ea560d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:38:10.176770 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc79d-8650-4b11-9d0c-efc645c1f00d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:10.177335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc79d-8650-4b11-9d0c-efc645c1f00d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:10.177335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc79d-8650-4b11-9d0c-efc645c1f00d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:10.178704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 432/854] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:10.184002 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:10.184478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:10.184574 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:10.202478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:10.203683 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:10.272609 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 423/855] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:10.606850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cc79d-8650-4b11-9d0c-efc645c1f00d None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:10.636133 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:10.726401 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cc79d-8650-4b11-9d0c-efc645c1f00d None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:10.762082 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:10.762721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:10.763046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:10.763375 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:10.774400 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:10.779603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:10.780843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:10.781805 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 433/856] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Aug 20 20:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:38:10.787176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:10.835024 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:10.911208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb55b9-2e5c-402a-b66e-f0ba3f88e8e2 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:10.950801 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:10.951537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:10.951820 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:10.952092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:10.952919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:10.953345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:10.955125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:10.964538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 424/857] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Aug 20 20:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:10.971280 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:11.067887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:11.086058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278daa2-adf0-4895-906f-fabd9de3b389 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:11.128917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:11.129742 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:11.130002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:11.130303 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:11.141040 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:11.142621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:11.159327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:11.160394 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:11.161760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:11.161760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:11.161760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:11.161760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 434/858] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:11.167253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:11.283350 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4b39-1957-40f1-9dd4-3840940c8fd1 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:11.285920 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:11.323045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:11.323565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:11.323843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:11.324109 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:11.324771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:11.325240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:11.327696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:11.341205 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 425/859] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:11.347041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:11.458634 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175a075-010a-4d5d-ac46-ca28da8449aa None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:11.494444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:11.495079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:11.495357 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:11.495628 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] PATH_INFO: `/v3/users/placement` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:11.498297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:11.503759 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:11.505216 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:11.521346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:11.522952 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:11.524590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 435/860] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:11.528454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:11.642430 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3d75-25f2-4f6e-94bb-b028f38d61c4 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:11.679846 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:11.680467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:11.680749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:11.681026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:11.681862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:11.682172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:11.683655 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:11.708344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 426/861] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:11.710241 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:11.818276 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7520c-a54a-4a59-b6f4-0e6f186cc08c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:11.861936 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:11.862795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:11.863191 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:11.863556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:11.945979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:11.954066 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:11.955706 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.064932 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 436/862] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:38:11 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 20 20:38:12.070886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:12.096686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:12.177202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9abcc-6912-4e99-85d4-ce6813667946 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:12.212480 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:12.213160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:12.213772 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:12.214042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:12.225567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:12.227082 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:12.243358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:12.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:12.250822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:12.250822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:12.250822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:12.250822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 427/863] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:12.251112 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:12.352542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:12.358802 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411fcd-8aef-43e4-99dd-a62f18d6e896 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:12.394042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:12.397317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:12.397694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:12.398012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:12.398679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:12.398989 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:12.400626 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.413853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 437/864] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:12.420507 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:12.504498 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:12.533882 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98d8-1426-4029-a334-edb66da5bd4c None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:12.571296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:12.571936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:12.572306 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:12.572669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:12.580502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:12.582047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:12.593854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:12.602019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:12.603404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 428/865] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 20 20:38:12.604107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:12.716682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeec0d-8a8d-44fb-a4f6-00d5392eb0d9 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:12.756891 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:12.757512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:12.757879 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:12.758152 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:12.758878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:12.759180 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:12.760663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db5d1e-8631-4adf-af3b-3b3fcf7fa19b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.774300 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 438/866] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:12.780531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:12.890266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1a8ae-c0f8-47ac-a3df-61b638a0d57b None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:12.934374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:12.935196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:12.935614 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:12.935973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:12.936709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] RBAC: Adding query filter params (role.id=adcba7f4047a4bf1830c13e93ea560d5, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed027c48f80c43ed82731961fa46e5e7) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:12.937048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:12.938533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eee7-5049-4522-bfd1-05b3635a8762 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:12.940554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:12.946015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 429/867] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:38:12 2022] GET /identity/v3/role_assignments?user.id=ed027c48f80c43ed82731961fa46e5e7&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=adcba7f4047a4bf1830c13e93ea560d5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:15.364264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59a91-639e-4d0f-8960-c0d39535c1ff None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:15.364792 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59a91-639e-4d0f-8960-c0d39535c1ff None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:15.364792 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59a91-639e-4d0f-8960-c0d39535c1ff None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:15.366157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 439/868] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:15.372371 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:15.372789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:15.373106 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:15.393742 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:15.394969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:15.469808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 430/869] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:15.810089 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59a91-639e-4d0f-8960-c0d39535c1ff None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:15.832426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:15.937719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59a91-639e-4d0f-8960-c0d39535c1ff None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:15.980240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:15.981002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:15.981248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:15.981514 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:15.993659 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:15.998691 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:15.999725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:16.000583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 440/870] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:16.007240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:16.128352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003d33d-31cd-4a9a-89c5-16b09f19b401 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:16.154793 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:16.163358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:16.163980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:16.164285 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:16.164561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:16.165351 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:16.165705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:16.167139 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:16.180725 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 431/871] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:16.182079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:16.260735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:16.285355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c49190-8c4f-4a27-9275-c8da4edf0836 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:16.325105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:16.325796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:16.326075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:16.326346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:16.339281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:16.340861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:16.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:16.356642 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:16.357761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:16.357761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:16.357761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:16.357761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 441/872] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:16.362611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:16.482322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59c941-27b1-470f-b04c-fd667b8e668d None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:16.520642 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:16.521393 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:16.521784 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:16.522052 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:16.522701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:16.523038 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:16.524414 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:16.537175 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 432/873] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:16.543455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:16.650113 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed3d-8ace-44b6-b041-69d612fa4b73 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:16.678725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:16.688727 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:16.689368 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:16.689685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:16.690017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:16.698533 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:16.699993 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:16.711319 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:16.712304 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:16.713315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 442/874] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:16.718758 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:16.769512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:16.826842 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a389-e71f-4293-ba27-885b2a3bf225 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:16.872355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:16.872979 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:16.873374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:16.873540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:16.874333 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:16.874638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:16.876514 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:16.898538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 433/875] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:16.905562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.031583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10906c-c636-4038-a3ed-dcc81ac90d5c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:17.070595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:17.071260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:17.071550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:17.071850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:17.137647 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:17.151556 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:17.153014 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:17.259547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 443/876] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:38:16 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 20 20:38:17.265832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.372579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7fb1-682d-42e0-811e-affc34deacb7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:17.383049 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:17.410562 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:17.411204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:17.411479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:17.411749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:17.422811 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:17.424291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:17.439707 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:17.440755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:17.441692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:17.441692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:17.441692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:17.441692 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 434/877] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:17.447857 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.541441 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:17.555934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da469-f23a-482a-a509-ea44e2d7618c None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:17.593391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:17.594176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:17.594454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:17.594721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:17.595377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:17.595678 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:17.597058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:17.617633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 444/878] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:17.617831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.718740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d34cc-9ee2-4020-b4dc-f08b4909f541 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:17.754033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:17.754666 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:17.754918 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:17.755207 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:17.761853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:17.763345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:17.774546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:17.775580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:17.776539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 435/879] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:17.781843 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.889992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6078-09c7-473c-bc07-c8660b5b91b4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:17.924471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:17.925097 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:17.925370 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:17.925644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:17.926352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:17.926653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:17.928080 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365ee4-a930-4c6f-bff7-57904b7e9ca7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:17.939944 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 445/880] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:17.946117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:17.969779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:18.049015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76182578-3888-4b43-ae06-351d225773a7 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:18.083878 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:18.084479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:18.084763 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:18.085037 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:18.085795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed027c48f80c43ed82731961fa46e5e7) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:18.086107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:18.087566 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9232033-321e-47f3-a7bd-abb6ba92ccc2 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:18.093440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 436/881] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:38:17 2022] GET /identity/v3/role_assignments?user.id=ed027c48f80c43ed82731961fa46e5e7&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:20.210684 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b2e7-8e88-424f-84cf-3d65e1308fd2 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:20.211258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b2e7-8e88-424f-84cf-3d65e1308fd2 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:20.211258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b2e7-8e88-424f-84cf-3d65e1308fd2 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:20.212571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 446/882] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:20.218641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:20.219058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:20.219203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:20.238339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:20.239565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:20.307813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 437/883] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:20.634323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85b2e7-8e88-424f-84cf-3d65e1308fd2 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:20.646423 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:20.753230 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85b2e7-8e88-424f-84cf-3d65e1308fd2 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:20.790169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:20.790790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:20.791065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:20.791334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:20.801422 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:20.806134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:20.807270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:20.808151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 447/884] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:20.816084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:20.834003 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:20.926017 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2df91-bdb3-4000-ae0d-689c5c10f4bf None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:20.960487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:20.961083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:20.961358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:20.961660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:20.962304 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:20.962606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:20.964320 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:20.972219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 438/885] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:20.978191 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.048920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:21.082211 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551b3d2-3098-4fb7-860c-11f071b0fce4 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:21.117315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:21.117960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:21.118232 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:21.118499 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:21.129151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:21.130626 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:21.146125 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:21.147258 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:21.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:21.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:21.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:21.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 448/886] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:21.154026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.235335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:21.260597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83d66-6248-4d26-a8d8-4e748c0a5481 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:21.308210 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:21.308825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:21.309103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:21.309393 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:21.310072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:21.310382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:21.311780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:21.324337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 439/887] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:21.330567 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.441458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5894fd-e51a-498d-8c2c-b7a9a71db429 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:21.461215 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:21.476634 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:21.477255 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:21.477534 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:21.477847 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:21.485402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:21.486828 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:21.497970 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:21.499052 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:21.500033 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 449/888] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:21.505227 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.612182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1d7b-48d1-4db4-ac0a-9c0d3c609a69 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:21.651345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:21.651960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:21.652238 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:21.652513 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:21.653241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:21.653548 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:21.655042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:21.658018 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:21.676447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 440/889] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:21.682992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.800736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ff41-bb9e-4aa2-b3f8-329411640f69 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:21.833178 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:21.833839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:21.834114 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:21.834458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:21.846284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:21.848006 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:21.866551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:21.867551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:21.868893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:21.868893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:21.868893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:21.868893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 450/890] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:21.875078 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:21.989069 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593a2d-6bcc-4050-a5a8-cb27361a4637 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:22.024547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:22.025145 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:22.025488 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:22.025783 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:22.026416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:22.026718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:22.028095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:22.039256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 441/891] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:22.045545 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:22.081482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:22.164485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a42-a190-499f-a23e-eea95f727d41 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:22.199991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:22.200627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:22.200907 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:22.201177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:22.208721 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:22.210252 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:22.222075 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:22.223098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:22.224012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 451/892] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:22.229464 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:22.288623 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:22.336776 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd9e1a-1162-4f0c-9a1e-879124f38b10 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:22.371341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:22.371943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:22.372221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:22.372492 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:22.373175 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:22.373478 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:22.374949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cafd9f-8a3c-4f3a-a590-2158184f9435 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:22.386785 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 442/893] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:22.396200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:22.495268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:22.508995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203357b1-dc6d-4385-888a-096e03723365 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:22.544506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:22.545155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:22.545437 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:22.545745 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] PATH_INFO: `/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed027c48f80c43ed82731961fa46e5e7/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:22.547775 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa966421e428ead408fd7843ee67a, user_id=ed027c48f80c43ed82731961fa46e5e7, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:22.549220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b079-072d-4ff7-bded-597401393ab7 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:22.568948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 452/894] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Aug 20 20:38:22 2022] PUT /identity/v3/projects/d05fa966421e428ead408fd7843ee67a/users/ed027c48f80c43ed82731961fa46e5e7/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:38:24.700663 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c35bf-2f73-4244-b998-f30312720e69 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:24.701197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c35bf-2f73-4244-b998-f30312720e69 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:24.701388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c35bf-2f73-4244-b998-f30312720e69 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:24.703280 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 443/895] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:24.712018 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:24.712430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:24.712603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:24.739856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:24.741055 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:24.813653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 453/896] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:25.165398 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c35bf-2f73-4244-b998-f30312720e69 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:25.276883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c35bf-2f73-4244-b998-f30312720e69 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:25.293051 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:25.320550 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:25.321223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:25.321499 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:25.321806 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:25.333084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 20 20:38:25.337812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:25.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 20 20:38:25.340226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:25.341804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 444/897] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Aug 20 20:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:25.345235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:25.429366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:25.451017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700e06-8ee6-4896-9ff0-66a7cc5cb524 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:25.485871 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:25.486470 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:25.486750 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:25.487019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:25.487693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:25.487999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:25.489380 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:25.497650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 454/898] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Aug 20 20:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:25.504319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:25.608206 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455c02-8f3a-4589-8849-7b6eb8bfa648 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:25.643253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:25.643871 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:25.644143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:25.644407 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:25.654530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:25.655979 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:25.671031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:25.673769 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:25.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:25.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:25.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:25.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 445/899] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:25.680353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:25.793561 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcbeeb-df8f-4f8a-948b-789dfe7b45c5 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:25.830615 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:25.831551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:25.831976 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:25.832400 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:25.833417 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:25.833930 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:25.836087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:25.849449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 455/900] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:25.855537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:25.887209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:25.964921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f49e9-12db-48e8-b7a5-830bdc76d513 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:26.001340 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:26.001995 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:26.002274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:26.002545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:26.010226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:26.011685 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 20 20:38:26.022930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:26.023900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:26.024966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 446/901] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:26.030163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:26.034277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:26.139310 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cc100-b65b-4f36-9b70-9f4e5897fb9f None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:26.188124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:26.188735 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:26.189015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:26.189290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:26.190054 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:26.190367 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:26.191811 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:26.210235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 456/902] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Aug 20 20:38:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:26.219880 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:26.312686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:26.331973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c7a-c1a8-472a-8bb4-59aa4da46a13 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:26.365561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:26.366198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:26.366474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:26.366745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:26.432997 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:26.434468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:26.521700 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:26.539867 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 447/903] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Aug 20 20:38:26 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 20 20:38:26.546414 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:26.614388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:26.653051 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323da0-aabb-4c3d-a26a-dfba0cca473a None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:26.688354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:26.688980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:26.689262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:26.689532 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:26.699963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:26.701426 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 20 20:38:26.717388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:26.718523 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 20 20:38:26.720025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 20 20:38:26.720025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 20 20:38:26.720025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:26.720025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 457/904] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:26.726834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:26.829974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44ed3-9abe-4daa-bf10-9cacdc6bdece None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:26.866512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:26.867124 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:26.867391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:26.867688 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:26.868335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:26.868637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:26.870081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:26.882112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 448/905] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Aug 20 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:26.887973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:26.990959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82e66d-1fe1-4ca8-a5d1-a6f468086add None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:27.004477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:27.025479 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:27.026138 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:27.026420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:27.026694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:27.033544 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:27.035039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 20 20:38:27.046458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:27.047446 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: ERROR keystone.server.flask.application Aug 20 20:38:27.048512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 458/906] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Aug 20 20:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:27.054228 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:27.109970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:27.172439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75033b94-bbaf-4613-a4c2-b6914ba67e61 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:27.221978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:27.222581 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:27.222858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:27.223125 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:27.223808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:27.224111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:27.225565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9943e3-9f95-4b3d-b13f-603e4ebd325b None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:27.238031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 449/907] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Aug 20 20:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:38:27.244308 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:27.347850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb7ff-10cd-4b77-9f17-4c5e1521ef16 None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:27.382741 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:27.383284 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:27.383564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:27.383834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:27.384586 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] RBAC: Adding query filter params (role.id=b8646ec5f7cb4e1e90f8388a4d681991, scope.project.id=d05fa966421e428ead408fd7843ee67a, user.id=ed027c48f80c43ed82731961fa46e5e7) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:27.384901 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:27.386373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38bef-93d7-48e5-8323-84d8b32423c1 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:27.392157 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 459/908] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Aug 20 20:38:27 2022] GET /identity/v3/role_assignments?user.id=ed027c48f80c43ed82731961fa46e5e7&scope.project.id=d05fa966421e428ead408fd7843ee67a&role.id=b8646ec5f7cb4e1e90f8388a4d681991 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:29.547908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81859b-67cd-4cba-bc5c-2279a4ac9d3f None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:29.548505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81859b-67cd-4cba-bc5c-2279a4ac9d3f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:29.548505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81859b-67cd-4cba-bc5c-2279a4ac9d3f None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:29.550555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 450/909] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:29.558548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:29.559024 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:29.559121 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:29.578898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:29.579992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:29.610833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:29.653336 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 460/910] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 20 20:38:29.989662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81859b-67cd-4cba-bc5c-2279a4ac9d3f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:30.126250 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81859b-67cd-4cba-bc5c-2279a4ac9d3f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:30.133349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:30.165906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:30.166543 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:30.166819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:30.167085 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:30.167662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:30.169042 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:30.180209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:30.181394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:30.182504 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 451/911] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Aug 20 20:38:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:30.187865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:30.287951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5df65c-fb36-4831-b9d5-604aa9fbbf40 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:30.324297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:30.324909 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:30.325185 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:30.325455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:30.326103 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:30.326415 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:30.327784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82fbed-6c76-4911-b77d-a443a1db8235 None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:30.333041 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 461/912] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Aug 20 20:38:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:30.339313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:30.441914 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7829e-e65b-42c8-b165-557ffb3f8c13 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:30.476491 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:30.477083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:30.477358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:30.477660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] PATH_INFO: `/v3/services` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:30.478286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:30.478593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:30.479977 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453f47b-548f-4170-87dd-ed944b152b07 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:30.484344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 452/913] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Aug 20 20:38:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:32.598685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aefc-9674-4e61-9c6e-0b6d1fd82c2d None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:32.599517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aefc-9674-4e61-9c6e-0b6d1fd82c2d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:32.599517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aefc-9674-4e61-9c6e-0b6d1fd82c2d None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:32.601609 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 462/914] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:32.607857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f3f4-89e6-49ef-a8cb-5f4df9aad1b2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:32.608522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f3f4-89e6-49ef-a8cb-5f4df9aad1b2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:32.608714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874f3f4-89e6-49ef-a8cb-5f4df9aad1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:32.631533 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f874f3f4-89e6-49ef-a8cb-5f4df9aad1b2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:32.632727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f874f3f4-89e6-49ef-a8cb-5f4df9aad1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:32.662542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:32.708803 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 453/915] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:33.037856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8aefc-9674-4e61-9c6e-0b6d1fd82c2d None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:33.082133 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:33.155552 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8aefc-9674-4e61-9c6e-0b6d1fd82c2d None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:33.191278 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:33.191878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:33.192155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:33.192430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:33.193063 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:33.194477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccaece-c983-4566-8628-3eab5e1a693b None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:33.212246 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 463/916] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Aug 20 20:38:33 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:38:35.335507 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c108a2-5a4f-4513-83eb-5eb8021158c1 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:35.336099 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c108a2-5a4f-4513-83eb-5eb8021158c1 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:35.336099 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c108a2-5a4f-4513-83eb-5eb8021158c1 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:35.338503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 454/917] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:35.343875 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:35.344316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:35.344424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:35.364140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:35.365297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:35.439099 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 464/918] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:35 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:35.755023 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c108a2-5a4f-4513-83eb-5eb8021158c1 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:35.875841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c108a2-5a4f-4513-83eb-5eb8021158c1 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:35.912659 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:35.913281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:35.913555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:35.913854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:35.914432 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:35.915848 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:35.925186 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:35.926339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:35.927311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:35.929796 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 455/919] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Aug 20 20:38:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:35.932379 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:35.952203 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:36.036873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aab936-57dc-4df2-8c49-00749c5b9a1f None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:36.081803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:36.082408 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:36.082687 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:36.082951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:36.083574 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:36.083872 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:36.085247 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:36.091162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 465/920] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Aug 20 20:38:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:36.097971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:36.130359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:36.223780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2f4a-a6a0-4ec4-8a7e-419d42d22e38 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:36.257893 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:36.258490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:36.258767 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:36.259033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:36.259718 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] RBAC: Adding query filter params (interface=public, service_id=37c3dec1b1094b7196bce7e474bcf624, region_id=RegionOne) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:36.260022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:36.261395 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3ba0-4b2f-4dea-b45f-082884086fd7 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:36.266440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 456/921] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Aug 20 20:38:36 2022] GET /identity/v3/endpoints?service_id=37c3dec1b1094b7196bce7e474bcf624&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:36.272577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:36.368807 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:36.392947 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f18f9-acf3-4678-a3d1-7d67337ba7bc None admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:36.431440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:36.432057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:36.432335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:36.432610 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:36.433215 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:36.434644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95526d42-9103-4f31-94b7-c3344b03de4a None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:36.441311 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 466/922] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Aug 20 20:38:36 2022] GET /identity/v3/services => generated 1962 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:38:38.582445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c93a4-a671-4041-be1c-3ba4cac1b63d None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:38.583238 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c93a4-a671-4041-be1c-3ba4cac1b63d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:38.583238 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c93a4-a671-4041-be1c-3ba4cac1b63d None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:38.585428 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 457/923] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:38:38.592060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:38.592794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:38.592887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:38.621088 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:38:38.622312 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:38:38.696821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 467/924] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:38:38 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 20 20:38:39.019886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c93a4-a671-4041-be1c-3ba4cac1b63d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:39.135638 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:39.146177 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c93a4-a671-4041-be1c-3ba4cac1b63d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:39.181838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:39.182454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:39.182730 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:39.183003 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:39.183580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:39.184966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 20 20:38:39.193786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 20 20:38:39.194906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.get_or_create( Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application with Lock( Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self._enter() Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application return self.creator() Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application created_value = creator( Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: ERROR keystone.server.flask.application Aug 20 20:38:39.196190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 458/925] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Aug 20 20:38:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 20 20:38:39.201463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:39.283668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:39.310962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91124d57-5893-456a-ad37-2cff9fe22892 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:39.346939 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:39.347550 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:39.347827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:39.348094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] PATH_INFO: `/v3/services` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:39.348723 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:38:39.349023 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:39.350433 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f36650-948c-4235-befb-e130dc77b3ac None admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:39.355500 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 468/926] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Aug 20 20:38:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:38:39.361555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:38:39.468862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682b96-48eb-449d-8256-c9fec9fcaf98 None admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:38:39.503482 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:38:39.504083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:38:39.504359 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:38:39.504628 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] PATH_INFO: `/v3/endpoints` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:38:39.505260 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:38:39.506674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65886ade-eace-4f08-a0e6-066c2fb8601e None admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:38:39.528802 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 459/927] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:38:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:38:49.352608 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=30 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:38:49.525118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:39:38.909674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94390bb-ffe3-4f8e-b72b-686ec9890790 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:38.910605 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94390bb-ffe3-4f8e-b72b-686ec9890790 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:38.911011 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94390bb-ffe3-4f8e-b72b-686ec9890790 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:38.912507 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 469/928] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:38.918073 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b64ee-023a-4b04-898a-7ad0ca7a27a7 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:38.918523 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b64ee-023a-4b04-898a-7ad0ca7a27a7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:38.918601 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b64ee-023a-4b04-898a-7ad0ca7a27a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:38.940702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-142b64ee-023a-4b04-898a-7ad0ca7a27a7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:38.942132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-142b64ee-023a-4b04-898a-7ad0ca7a27a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:39.041683 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 460/929] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:39.384463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8358d-68a5-4c22-bd16-2e5a9957e1cc None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:39.384645 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8358d-68a5-4c22-bd16-2e5a9957e1cc None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:39.386487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8358d-68a5-4c22-bd16-2e5a9957e1cc None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:39.386487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 470/930] 10.222.0.20 () {54 vars in 965 bytes} [Sat Aug 20 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:39.392688 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c68b4a-32db-4959-822c-794b186d800b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:39.393083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c68b4a-32db-4959-822c-794b186d800b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:39.393434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c68b4a-32db-4959-822c-794b186d800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:39.472010 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-72c68b4a-32db-4959-822c-794b186d800b None None] MFA Rules not processed for user `3624329d433947bf941772510a5423fb`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:39.473281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-72c68b4a-32db-4959-822c-794b186d800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:39.565846 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 461/931] 10.222.0.20 () {58 vars in 1062 bytes} [Sat Aug 20 20:39:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:39.575423 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8358d-68a5-4c22-bd16-2e5a9957e1cc None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:39.597653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8358d-68a5-4c22-bd16-2e5a9957e1cc None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:39.602095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:39.603092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:39.603578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:39.604006 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:39.616529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:39.618019 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9b4c-e02b-434f-8b37-863004ad88bd service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:39.628475 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 471/932] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:39:42.015387 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091bba1-f3b3-4640-b2aa-b5b179fbd074 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:42.015947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091bba1-f3b3-4640-b2aa-b5b179fbd074 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:42.015947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091bba1-f3b3-4640-b2aa-b5b179fbd074 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:42.017256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 462/933] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:42.022737 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764872ae-cb2e-4196-ba82-5631dd1be273 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:42.023183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764872ae-cb2e-4196-ba82-5631dd1be273 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:42.023369 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764872ae-cb2e-4196-ba82-5631dd1be273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:42.044280 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-764872ae-cb2e-4196-ba82-5631dd1be273 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:42.045486 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-764872ae-cb2e-4196-ba82-5631dd1be273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:42.054334 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 472/934] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:42.383283 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091bba1-f3b3-4640-b2aa-b5b179fbd074 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:42.395317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091bba1-f3b3-4640-b2aa-b5b179fbd074 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:42.399653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:42.400277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:42.400554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:42.400825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:42.410822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:42.412270 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63315a-7f84-4a78-96b9-a8ca8afd48ef service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:42.421761 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 463/935] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:39:44.893605 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02103e-e95b-484b-891e-17516bf765b2 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:44.894225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02103e-e95b-484b-891e-17516bf765b2 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:44.894225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02103e-e95b-484b-891e-17516bf765b2 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:44.897726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 473/936] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:44.900921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141f90-8b45-4fb5-805e-4bbe9e1cb529 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:44.901354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141f90-8b45-4fb5-805e-4bbe9e1cb529 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:44.901462 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141f90-8b45-4fb5-805e-4bbe9e1cb529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:44.942357 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-60141f90-8b45-4fb5-805e-4bbe9e1cb529 None None] MFA Rules not processed for user `9741b954d54c450cae582dc4de0ecb97`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:44.943596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-60141f90-8b45-4fb5-805e-4bbe9e1cb529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:44.986726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:39:45.015739 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 464/937] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:44 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:45.366825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0766b-adb0-4956-877e-90d90fb72146 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:45.367110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0766b-adb0-4956-877e-90d90fb72146 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:45.367384 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0766b-adb0-4956-877e-90d90fb72146 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:45.368959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 474/938] 10.222.0.20 () {54 vars in 965 bytes} [Sat Aug 20 20:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:45.375765 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658525c6-5b6a-437e-8d93-7e81ac7c13b2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:45.376007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658525c6-5b6a-437e-8d93-7e81ac7c13b2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:45.376309 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658525c6-5b6a-437e-8d93-7e81ac7c13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:45.398653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-658525c6-5b6a-437e-8d93-7e81ac7c13b2 None None] MFA Rules not processed for user `3624329d433947bf941772510a5423fb`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:45.399819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-658525c6-5b6a-437e-8d93-7e81ac7c13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:45.406618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 465/939] 10.222.0.20 () {58 vars in 1062 bytes} [Sat Aug 20 20:39:45 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:45.415177 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0766b-adb0-4956-877e-90d90fb72146 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:45.426239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0766b-adb0-4956-877e-90d90fb72146 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:45.429724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:45.430323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:45.430593 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:45.430859 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:45.439896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:45.441377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476549b-53fc-4bec-8458-3a320122c5af service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:45.450979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 475/940] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:45 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:39:48.518876 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1423-6cbb-48c3-bed9-024caf1fab4d None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:48.519447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1423-6cbb-48c3-bed9-024caf1fab4d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:48.519447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1423-6cbb-48c3-bed9-024caf1fab4d None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:48.521411 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 466/941] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:48.527007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff5f8-fbb3-4c99-b6e7-339e5befbd4c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:48.527447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff5f8-fbb3-4c99-b6e7-339e5befbd4c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:48.527536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff5f8-fbb3-4c99-b6e7-339e5befbd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:48.547887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-9d4ff5f8-fbb3-4c99-b6e7-339e5befbd4c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:48.549074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-9d4ff5f8-fbb3-4c99-b6e7-339e5befbd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:48.619480 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 476/942] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:48.957675 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1423-6cbb-48c3-bed9-024caf1fab4d None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:48.975630 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1423-6cbb-48c3-bed9-024caf1fab4d None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:48.979981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:48.980584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:48.980866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:48.981133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:48.993445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:48.995022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d64e3c-88b1-4cad-a326-56975702364d service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:49.004516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 467/943] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:48 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:39:51.889234 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a30-1a83-4521-8fb3-a083b7d6d62a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:51.889818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a30-1a83-4521-8fb3-a083b7d6d62a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:51.889818 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a30-1a83-4521-8fb3-a083b7d6d62a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:51.891136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 477/944] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:51.896428 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd859e-cefc-48b2-b1c7-8647573e47f0 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:51.896853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd859e-cefc-48b2-b1c7-8647573e47f0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:51.896939 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd859e-cefc-48b2-b1c7-8647573e47f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:51.916567 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-effd859e-cefc-48b2-b1c7-8647573e47f0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:51.917795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-effd859e-cefc-48b2-b1c7-8647573e47f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:51.925891 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 468/945] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:52.252877 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c866a30-1a83-4521-8fb3-a083b7d6d62a None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:52.264994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c866a30-1a83-4521-8fb3-a083b7d6d62a None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:52.268898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:52.269501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:52.269819 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:52.270093 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:52.279017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:52.280457 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e6986-149b-4e01-9cdd-c7b8ae9fade8 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:52.289943 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 478/946] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:39:54.463759 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d59437-7dd1-4c57-b170-d118b5843253 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:54.464302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d59437-7dd1-4c57-b170-d118b5843253 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:54.464302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d59437-7dd1-4c57-b170-d118b5843253 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:54.465654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 469/947] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:54.470917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8280-5ca7-4fb7-ae0d-9ef5195fb863 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:54.471345 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8280-5ca7-4fb7-ae0d-9ef5195fb863 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:54.471566 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8280-5ca7-4fb7-ae0d-9ef5195fb863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:54.491497 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-a43d8280-5ca7-4fb7-ae0d-9ef5195fb863 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:54.492692 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-a43d8280-5ca7-4fb7-ae0d-9ef5195fb863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:54.501143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 479/948] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:54.836629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d59437-7dd1-4c57-b170-d118b5843253 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:54.847919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d59437-7dd1-4c57-b170-d118b5843253 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:54.851728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:54.852317 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:54.852590 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:54.852854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:54.862927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:54.864363 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae411-1e27-442f-8cd1-5da496451b4d service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:54.873831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 470/949] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:39:57.108587 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebc14-862a-4879-ad9b-bc223b8ea639 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:57.109131 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebc14-862a-4879-ad9b-bc223b8ea639 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:57.109131 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebc14-862a-4879-ad9b-bc223b8ea639 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:57.110501 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 480/950] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:57.115927 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ec15-5f4f-4cc4-8a27-072cb4e66c13 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:57.116373 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ec15-5f4f-4cc4-8a27-072cb4e66c13 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:57.116594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ec15-5f4f-4cc4-8a27-072cb4e66c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:57.136445 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a2f5ec15-5f4f-4cc4-8a27-072cb4e66c13 None None] MFA Rules not processed for user `9741b954d54c450cae582dc4de0ecb97`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:57.137657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a2f5ec15-5f4f-4cc4-8a27-072cb4e66c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:57.146157 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 471/951] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:57 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:39:57.489443 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebc14-862a-4879-ad9b-bc223b8ea639 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:39:57.500765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebc14-862a-4879-ad9b-bc223b8ea639 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:39:57.504547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:39:57.505205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:57.505487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:57.505791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:57.514831 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:39:57.516264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e38317-f0fa-4392-98f8-fe60951e0762 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:39:57.525675 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 481/952] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:39:57 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:39:59.952072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafade1-8818-4a6a-9897-4f4b4c613425 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:59.952670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafade1-8818-4a6a-9897-4f4b4c613425 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:59.952670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafade1-8818-4a6a-9897-4f4b4c613425 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:59.953988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 472/953] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:39:59.959767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79ac3-31dd-4723-b8f5-a401f39c0f72 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:39:59.960213 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79ac3-31dd-4723-b8f5-a401f39c0f72 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:39:59.960303 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79ac3-31dd-4723-b8f5-a401f39c0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:39:59.980348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-93c79ac3-31dd-4723-b8f5-a401f39c0f72 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:39:59.981535 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-93c79ac3-31dd-4723-b8f5-a401f39c0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:39:59.990861 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 482/954] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:39:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:00.321474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafade1-8818-4a6a-9897-4f4b4c613425 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:00.333113 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafade1-8818-4a6a-9897-4f4b4c613425 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:00.337044 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:00.337662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:00.337946 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:00.338213 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:00.347272 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:00.348709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec58e1a-654e-4210-9554-dd34de691fb0 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:00.358531 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 473/955] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:02.553447 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85763-d466-4f53-becf-a3a87d3d2359 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:02.554047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85763-d466-4f53-becf-a3a87d3d2359 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:02.554047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85763-d466-4f53-becf-a3a87d3d2359 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:02.555420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 483/956] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:02.560748 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1128-c89f-436c-92fb-ca8e10c94bd0 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:02.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1128-c89f-436c-92fb-ca8e10c94bd0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:02.561307 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1128-c89f-436c-92fb-ca8e10c94bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:02.580723 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-885d1128-c89f-436c-92fb-ca8e10c94bd0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:02.581931 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-885d1128-c89f-436c-92fb-ca8e10c94bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:02.591580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 474/957] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:02.930894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85763-d466-4f53-becf-a3a87d3d2359 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:02.949366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85763-d466-4f53-becf-a3a87d3d2359 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:02.953002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:02.953608 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:02.953918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:02.954186 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:02.964552 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:02.966128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377edf1-adcc-475d-95f3-3dc42bbe9d8b service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:02.976521 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 484/958] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:05.460963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda270e-a607-4427-a13f-dd7424cede2c None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:05.461519 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda270e-a607-4427-a13f-dd7424cede2c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:05.461519 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda270e-a607-4427-a13f-dd7424cede2c None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:05.462869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 475/959] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:05.469116 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890cf32-bcef-4fd1-978c-462b4b8c8ed3 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:05.469573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890cf32-bcef-4fd1-978c-462b4b8c8ed3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:05.469749 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890cf32-bcef-4fd1-978c-462b4b8c8ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:05.496429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7890cf32-bcef-4fd1-978c-462b4b8c8ed3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:05.497637 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7890cf32-bcef-4fd1-978c-462b4b8c8ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:05.506902 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 485/960] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:05 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:05.843628 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda270e-a607-4427-a13f-dd7424cede2c None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:05.856475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda270e-a607-4427-a13f-dd7424cede2c None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:05.861022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:05.861696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:05.862007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:05.862255 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:05.871841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:05.873306 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd89b-e3bd-4d9d-8046-79f9af344f6e service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:05.883100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 476/961] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:05 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:09.956863 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e186-afcd-4735-afcf-1c20cf3daa2e None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:09.957391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e186-afcd-4735-afcf-1c20cf3daa2e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:09.957391 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e186-afcd-4735-afcf-1c20cf3daa2e None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:09.959025 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 486/962] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:09.964391 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ff17-95dd-4a9a-b953-944984f519e0 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:09.964831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ff17-95dd-4a9a-b953-944984f519e0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:09.964928 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ff17-95dd-4a9a-b953-944984f519e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:09.985081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-88f1ff17-95dd-4a9a-b953-944984f519e0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:09.986431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-88f1ff17-95dd-4a9a-b953-944984f519e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:09.995790 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 477/963] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:10.325236 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2e186-afcd-4735-afcf-1c20cf3daa2e None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:10.330762 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=74 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:40:10.337569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2e186-afcd-4735-afcf-1c20cf3daa2e None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:10.341259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:10.341903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:10.342183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:10.342455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:10.351893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:10.353340 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6aa8-fde0-4fd2-8ea7-c0e00ab20ff4 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:10.363298 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 487/964] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:13.297908 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40edd-f7ea-49f9-a45e-1a68a37a0e85 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:13.298511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40edd-f7ea-49f9-a45e-1a68a37a0e85 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:13.298511 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40edd-f7ea-49f9-a45e-1a68a37a0e85 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:13.299755 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 478/965] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:13.305093 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34e55-e072-47c5-a707-768fef7629a4 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:13.305542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34e55-e072-47c5-a707-768fef7629a4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:13.305794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34e55-e072-47c5-a707-768fef7629a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:13.326624 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-49d34e55-e072-47c5-a707-768fef7629a4 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:13.327797 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-49d34e55-e072-47c5-a707-768fef7629a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:13.337193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:13 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:13.675101 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40edd-f7ea-49f9-a45e-1a68a37a0e85 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:13.686992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40edd-f7ea-49f9-a45e-1a68a37a0e85 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:13.691243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:13.691866 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:13.692149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:13.692421 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:13.703486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:13.705036 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7022-9121-490d-80fd-8a719ffbd7c0 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:13.716237 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 479/967] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:13 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:18.021081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632d12-5eb6-482d-894e-362d1fedd524 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:18.021723 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632d12-5eb6-482d-894e-362d1fedd524 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:18.021723 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632d12-5eb6-482d-894e-362d1fedd524 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:18.022972 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 489/968] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:18.028431 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400bfd-8f4e-4f6f-8cd6-925673b585be None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:18.028862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400bfd-8f4e-4f6f-8cd6-925673b585be None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:18.028963 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400bfd-8f4e-4f6f-8cd6-925673b585be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:18.037040 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=57 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:40:18.050390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-ff400bfd-8f4e-4f6f-8cd6-925673b585be None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:18.051582 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-ff400bfd-8f4e-4f6f-8cd6-925673b585be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:18.060326 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 480/969] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:18.393758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632d12-5eb6-482d-894e-362d1fedd524 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:18.405455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632d12-5eb6-482d-894e-362d1fedd524 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:18.409544 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:18.410203 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:18.410483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:18.410757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:18.420648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:18.422123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936236b-78cf-4853-aaeb-8a8180ef625a service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:18.431365 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 490/970] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:23.712451 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3a6d-4f16-488d-88a4-00db92f258cb None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:23.713343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3a6d-4f16-488d-88a4-00db92f258cb None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:23.714727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3a6d-4f16-488d-88a4-00db92f258cb None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:23.716741 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 481/971] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:40:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:23.724347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31376e-4755-405c-b786-032a9e2cd2e7 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:23.724752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31376e-4755-405c-b786-032a9e2cd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:23.724966 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31376e-4755-405c-b786-032a9e2cd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:23.770538 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-df31376e-4755-405c-b786-032a9e2cd2e7 None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:23.771958 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-df31376e-4755-405c-b786-032a9e2cd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:23.863509 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 491/972] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:40:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:28.045392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=2 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:40:28.469691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfa52-fbe6-4430-809b-afe7299a29c5 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:28.470229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfa52-fbe6-4430-809b-afe7299a29c5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:28.470522 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfa52-fbe6-4430-809b-afe7299a29c5 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:28.472048 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 482/973] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:28.477232 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab220-e459-4657-b896-030cdd573c2c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:28.477753 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab220-e459-4657-b896-030cdd573c2c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:28.477834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab220-e459-4657-b896-030cdd573c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:28.498204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-008ab220-e459-4657-b896-030cdd573c2c None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:28.499479 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-008ab220-e459-4657-b896-030cdd573c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:28.510081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 492/974] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:40:28 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:30.008875 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74e9f-5277-4547-aaf7-1a9c36daf752 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:30.009487 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74e9f-5277-4547-aaf7-1a9c36daf752 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:30.009579 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac74e9f-5277-4547-aaf7-1a9c36daf752 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:30.010900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 483/975] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:30.016007 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e11c-6deb-408b-bbee-8ff96cebd078 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:30.016420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e11c-6deb-408b-bbee-8ff96cebd078 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:30.016689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e11c-6deb-408b-bbee-8ff96cebd078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:30.037162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-2327e11c-6deb-408b-bbee-8ff96cebd078 None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:30.038428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-2327e11c-6deb-408b-bbee-8ff96cebd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:30.048424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 493/976] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:40:30 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:33.790183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667009-f928-454a-b9fe-7f918f362bbb None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:33.791027 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667009-f928-454a-b9fe-7f918f362bbb None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:33.791465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667009-f928-454a-b9fe-7f918f362bbb None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:33.792960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 484/977] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:33.798148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c368c-0578-48e4-8ef7-9d39b1f4993e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:33.798583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c368c-0578-48e4-8ef7-9d39b1f4993e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:33.798698 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c368c-0578-48e4-8ef7-9d39b1f4993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:33.817868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-428c368c-0578-48e4-8ef7-9d39b1f4993e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:33.819421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-428c368c-0578-48e4-8ef7-9d39b1f4993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:33.827374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 494/978] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:34.184046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbefe-13eb-4d7c-8325-cbc09ceb6118 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:34.184853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbefe-13eb-4d7c-8325-cbc09ceb6118 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:34.185380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbefe-13eb-4d7c-8325-cbc09ceb6118 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:34.187278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 485/979] 10.222.0.20 () {54 vars in 962 bytes} [Sat Aug 20 20:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:34.197879 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05f16-132e-4e43-94da-318ee074e192 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:34.199396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05f16-132e-4e43-94da-318ee074e192 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:34.200200 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05f16-132e-4e43-94da-318ee074e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:34.241015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-7da05f16-132e-4e43-94da-318ee074e192 None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:34.242424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-7da05f16-132e-4e43-94da-318ee074e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:34.315616 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=100 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:40:34.323826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 495/980] 10.222.0.20 () {58 vars in 1059 bytes} [Sat Aug 20 20:40:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:34.331545 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbefe-13eb-4d7c-8325-cbc09ceb6118 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:34.345954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbefe-13eb-4d7c-8325-cbc09ceb6118 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:34.351192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:34.352118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:34.352554 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:34.352831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:34.361475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:34.363599 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1792829-9283-4aed-a7cd-690c298f4942 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:34.374004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 486/981] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:36.731050 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7c26-4deb-4ce7-8848-cf717c7f1756 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:36.731535 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7c26-4deb-4ce7-8848-cf717c7f1756 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:36.731627 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7c26-4deb-4ce7-8848-cf717c7f1756 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:36.732923 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 496/982] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:36.738446 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d47a3-c4ca-45a2-8ddd-abc45f5e940a None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:36.738896 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d47a3-c4ca-45a2-8ddd-abc45f5e940a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:36.739004 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d47a3-c4ca-45a2-8ddd-abc45f5e940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:36.758029 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-cf7d47a3-c4ca-45a2-8ddd-abc45f5e940a None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:36.759410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-cf7d47a3-c4ca-45a2-8ddd-abc45f5e940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:36.767662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 487/983] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:37.107614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7c26-4deb-4ce7-8848-cf717c7f1756 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:37.122529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7c26-4deb-4ce7-8848-cf717c7f1756 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:37.128411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:37.129138 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:37.129517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:37.129982 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:37.139098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:37.140904 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb67ec-676e-4c61-b72e-69bcfb167a07 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:37.151359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 497/984] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:39.712664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da09ba-63f9-4e40-9806-725fbba2afc3 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:39.713176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da09ba-63f9-4e40-9806-725fbba2afc3 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:39.713257 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da09ba-63f9-4e40-9806-725fbba2afc3 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:39.714654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 488/985] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:39.720278 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc2e9-9468-464d-8088-2af32df8c578 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:39.720668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc2e9-9468-464d-8088-2af32df8c578 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:39.720855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc2e9-9468-464d-8088-2af32df8c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:39.741575 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-eb8bc2e9-9468-464d-8088-2af32df8c578 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:39.742799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-eb8bc2e9-9468-464d-8088-2af32df8c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:39.751463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 498/986] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:40.105770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be1c8-e15e-432f-8575-f16cc69dd676 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:40.106149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be1c8-e15e-432f-8575-f16cc69dd676 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:40.106334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be1c8-e15e-432f-8575-f16cc69dd676 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:40.107668 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 489/987] 10.222.0.20 () {54 vars in 962 bytes} [Sat Aug 20 20:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:40.113438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850770-37c6-4aad-b107-1cf0c892522b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:40.113973 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850770-37c6-4aad-b107-1cf0c892522b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:40.114506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850770-37c6-4aad-b107-1cf0c892522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:40.136029 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-78850770-37c6-4aad-b107-1cf0c892522b None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:40.139264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-78850770-37c6-4aad-b107-1cf0c892522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:40.150620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 499/988] 10.222.0.20 () {58 vars in 1059 bytes} [Sat Aug 20 20:40:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:40.157953 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be1c8-e15e-432f-8575-f16cc69dd676 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:40.177822 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be1c8-e15e-432f-8575-f16cc69dd676 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:40.182936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:40.183786 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:40.184287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:40.184766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:40.194266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:40.196230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8194ad6-951d-4a70-889b-543762a41424 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:40.208542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 490/989] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:42.555333 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d285-52b8-44b9-8596-cdd2d4d90537 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:42.556372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d285-52b8-44b9-8596-cdd2d4d90537 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:42.556890 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d285-52b8-44b9-8596-cdd2d4d90537 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:42.562703 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 500/990] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:42.565422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf0c43-88b3-41c8-9cdf-1cebee9c737c None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:42.565900 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf0c43-88b3-41c8-9cdf-1cebee9c737c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:42.566092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf0c43-88b3-41c8-9cdf-1cebee9c737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:42.586970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-04cf0c43-88b3-41c8-9cdf-1cebee9c737c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:42.588479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-04cf0c43-88b3-41c8-9cdf-1cebee9c737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:42.597394 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 491/991] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:42.947894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d285-52b8-44b9-8596-cdd2d4d90537 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:42.964193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d285-52b8-44b9-8596-cdd2d4d90537 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:42.969887 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:42.970682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:42.975064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:42.975516 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:42.985238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:42.987071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9beea5-5252-489a-990e-290c5e3cf2fe service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:42.997196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 501/992] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:43.791904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad7b9-a076-4321-a433-54efd740a553 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:43.792376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad7b9-a076-4321-a433-54efd740a553 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:43.792458 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad7b9-a076-4321-a433-54efd740a553 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:43.794152 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 492/993] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:43.805540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4779-5f3d-40aa-a01f-7e1a7be79bba None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:43.807722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4779-5f3d-40aa-a01f-7e1a7be79bba None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:43.809071 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4779-5f3d-40aa-a01f-7e1a7be79bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:43.881413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f64c4779-5f3d-40aa-a01f-7e1a7be79bba None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:43.887832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f64c4779-5f3d-40aa-a01f-7e1a7be79bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:43.900030 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 502/994] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:44.500580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c0a9-9ed8-45e5-83e2-bcadb3b304ca None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:44.500580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c0a9-9ed8-45e5-83e2-bcadb3b304ca None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:44.500580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c0a9-9ed8-45e5-83e2-bcadb3b304ca None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:44.502876 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 493/995] 10.222.0.20 () {54 vars in 964 bytes} [Sat Aug 20 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:44.506413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1ea8-6e66-420e-8108-09b4c3b66436 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:44.506665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1ea8-6e66-420e-8108-09b4c3b66436 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:44.506967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1ea8-6e66-420e-8108-09b4c3b66436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:44.544943 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f22f1ea8-6e66-420e-8108-09b4c3b66436 None None] MFA Rules not processed for user `032ee4c6594a4085899e30d2e96bb783`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:44.546199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f22f1ea8-6e66-420e-8108-09b4c3b66436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:44.607874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 503/996] 10.222.0.20 () {58 vars in 1061 bytes} [Sat Aug 20 20:40:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:44.615328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029c0a9-9ed8-45e5-83e2-bcadb3b304ca None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:44.626625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029c0a9-9ed8-45e5-83e2-bcadb3b304ca None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:44.630216 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '032ee4c6594a4085899e30d2e96bb783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:44.630819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:44.631094 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:44.631365 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:44.640526 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:44.642031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde8f1-835a-486e-a856-f1830e560cf2 service cinder] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:44.651766 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 494/997] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:40:45.269386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab8ad-458f-4f26-9836-cfdfa494efb6 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:45.269975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab8ad-458f-4f26-9836-cfdfa494efb6 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:45.269975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab8ad-458f-4f26-9836-cfdfa494efb6 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:45.271212 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 504/998] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:45.277268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb47a1-92a7-49a1-a269-c71d5c1eb1ac None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:45.277809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb47a1-92a7-49a1-a269-c71d5c1eb1ac None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:45.278077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb47a1-92a7-49a1-a269-c71d5c1eb1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:45.304954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-bddb47a1-92a7-49a1-a269-c71d5c1eb1ac None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:45.306382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-bddb47a1-92a7-49a1-a269-c71d5c1eb1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:45.316947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 495/999] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:45.667700 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab8ad-458f-4f26-9836-cfdfa494efb6 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:45.696985 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab8ad-458f-4f26-9836-cfdfa494efb6 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:45.703453 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:45.704428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:45.705013 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:45.705608 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:45.717431 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:45.719395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf8543-2252-454c-9321-37fc90e17490 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:45.731622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 505/1000] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:47.917059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0ac5-e9da-48c7-8070-c1cb89f50cf0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:47.917701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0ac5-e9da-48c7-8070-c1cb89f50cf0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:47.917701 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0ac5-e9da-48c7-8070-c1cb89f50cf0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:47.918972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 496/1001] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:47.925035 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ae8-6797-42cd-a9a2-76265aad9af8 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:47.926056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ae8-6797-42cd-a9a2-76265aad9af8 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:47.926204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ae8-6797-42cd-a9a2-76265aad9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:47.952354 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-dbda2ae8-6797-42cd-a9a2-76265aad9af8 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:47.953714 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-dbda2ae8-6797-42cd-a9a2-76265aad9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:47.963632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 506/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:48.307516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc0ac5-e9da-48c7-8070-c1cb89f50cf0 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:48.321912 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc0ac5-e9da-48c7-8070-c1cb89f50cf0 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:48.327551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:48.328174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:48.328456 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:48.328731 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:48.337698 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:48.339322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7862fa5-0244-4b3c-800b-acb7f73b6559 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:48.348783 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 497/1003] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:50.577690 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017d08-1ad5-43b8-97f8-baa8eba98c82 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:50.578235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017d08-1ad5-43b8-97f8-baa8eba98c82 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:50.578484 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017d08-1ad5-43b8-97f8-baa8eba98c82 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:50.579950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 507/1004] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:50.585836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afc66-5173-43af-ba23-558141e49e00 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:50.586311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afc66-5173-43af-ba23-558141e49e00 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:50.586399 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afc66-5173-43af-ba23-558141e49e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:50.606397 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-3e9afc66-5173-43af-ba23-558141e49e00 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:50.607943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-3e9afc66-5173-43af-ba23-558141e49e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:50.617278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 498/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:50.957099 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb017d08-1ad5-43b8-97f8-baa8eba98c82 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:50.971032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb017d08-1ad5-43b8-97f8-baa8eba98c82 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:50.975950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:50.976562 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:50.976803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:50.977107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:50.985291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:50.986975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c59a-493a-4c29-9fb8-1fda3aca3565 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:50.996565 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 508/1006] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:53.170582 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082000-db78-4495-8d7c-8d4c8f0623ca None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:53.171160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082000-db78-4495-8d7c-8d4c8f0623ca None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:53.171160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082000-db78-4495-8d7c-8d4c8f0623ca None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:53.172597 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 499/1007] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:53.180048 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3d0a-d879-48f2-93e1-026227a88b03 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:53.180736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3d0a-d879-48f2-93e1-026227a88b03 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:53.180736 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3d0a-d879-48f2-93e1-026227a88b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:53.201987 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-ceab3d0a-d879-48f2-93e1-026227a88b03 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:53.203242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ceab3d0a-d879-48f2-93e1-026227a88b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:53.213056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 509/1008] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:53.554561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3082000-db78-4495-8d7c-8d4c8f0623ca None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:53.575728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3082000-db78-4495-8d7c-8d4c8f0623ca None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:53.583728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:53.584686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:53.585117 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:53.585547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:53.597335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:53.599058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69af06-9e7d-461f-b0f1-8795a90764f4 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:53.609371 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 500/1009] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:40:57.101397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072d60-0365-4fa8-9c38-59a51100752a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:57.102171 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072d60-0365-4fa8-9c38-59a51100752a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:57.102313 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072d60-0365-4fa8-9c38-59a51100752a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:57.104524 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 510/1010] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:40:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:40:57.110310 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843c-045f-4cf5-9525-a6419be2d49c None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:57.110971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843c-045f-4cf5-9525-a6419be2d49c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:57.110971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138843c-045f-4cf5-9525-a6419be2d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:57.131729 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d138843c-045f-4cf5-9525-a6419be2d49c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:40:57.133035 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d138843c-045f-4cf5-9525-a6419be2d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:40:57.141629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 501/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:40:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:40:57.704898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14072d60-0365-4fa8-9c38-59a51100752a None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:40:57.719463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14072d60-0365-4fa8-9c38-59a51100752a None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:40:57.724753 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:40:57.725383 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:40:57.725654 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:40:57.725934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:40:57.734975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:40:57.737559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e90c1-4845-47bb-bbf3-f694bf11eccf service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:40:57.753032 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 511/1012] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:40:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:41:00.214011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598fe1-8bcd-4995-8eff-f6b90eebdebe None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.214625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598fe1-8bcd-4995-8eff-f6b90eebdebe None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.214625 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598fe1-8bcd-4995-8eff-f6b90eebdebe None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.215853 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 502/1013] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:00.221335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609666-4a0f-434d-af2d-c958a3467ca3 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.221893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609666-4a0f-434d-af2d-c958a3467ca3 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.221893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609666-4a0f-434d-af2d-c958a3467ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.241568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-ba609666-4a0f-434d-af2d-c958a3467ca3 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:00.242820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ba609666-4a0f-434d-af2d-c958a3467ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:00.251937 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 512/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:41:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:00.500172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba1d-bf10-4f7f-9447-13a6474018ed None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.500450 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba1d-bf10-4f7f-9447-13a6474018ed None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.500679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba1d-bf10-4f7f-9447-13a6474018ed None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.502100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 503/1015] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:00.507506 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525c0-e346-4ab3-a74f-df09dc191c0c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.508099 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525c0-e346-4ab3-a74f-df09dc191c0c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.508351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525c0-e346-4ab3-a74f-df09dc191c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.528589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-c6c525c0-e346-4ab3-a74f-df09dc191c0c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:00.529806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-c6c525c0-e346-4ab3-a74f-df09dc191c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:00.538969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 513/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:41:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:00.593136 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ba1d-bf10-4f7f-9447-13a6474018ed None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:00.600981 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=46 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:00.607937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ba1d-bf10-4f7f-9447-13a6474018ed None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:00.613302 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:00.613917 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.614197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.614467 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.622789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:00.624455 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bd3b0-5f4a-49fa-8f19-8402c41455d7 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:00.634093 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 504/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:00.897903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c86e7-a17e-453b-a863-cc98d05638a9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.898196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c86e7-a17e-453b-a863-cc98d05638a9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.898470 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c86e7-a17e-453b-a863-cc98d05638a9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.899859 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 514/1018] 10.222.0.20 () {54 vars in 967 bytes} [Sat Aug 20 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:00.905256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d727f-7a16-4961-80b6-51fb2bf88d66 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:00.905547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d727f-7a16-4961-80b6-51fb2bf88d66 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:00.905858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d727f-7a16-4961-80b6-51fb2bf88d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:00.945559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-167d727f-7a16-4961-80b6-51fb2bf88d66 None None] MFA Rules not processed for user `ed64374e93484949aeca834b88b14e42`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:00.946792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-167d727f-7a16-4961-80b6-51fb2bf88d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:01.009237 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 505/1019] 10.222.0.20 () {58 vars in 1064 bytes} [Sat Aug 20 20:41:00 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:01.017166 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c86e7-a17e-453b-a863-cc98d05638a9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:01.028777 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c86e7-a17e-453b-a863-cc98d05638a9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:01.032397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed64374e93484949aeca834b88b14e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:01.032993 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:01.033266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:01.033531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:01.042837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:01.044269 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703f8ed-19a9-4a91-b78e-6bbfdd103706 service glance] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:01.054299 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 515/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:02.875972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1737b5-3868-4740-ad79-fd834ca04916 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:02.876678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1737b5-3868-4740-ad79-fd834ca04916 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:02.876678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1737b5-3868-4740-ad79-fd834ca04916 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:02.877935 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 506/1021] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:02.883941 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154821f-cfe5-48a8-895e-f9fc37a9e374 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:02.884395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154821f-cfe5-48a8-895e-f9fc37a9e374 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:02.884594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154821f-cfe5-48a8-895e-f9fc37a9e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:02.905048 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-5154821f-cfe5-48a8-895e-f9fc37a9e374 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:02.906316 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-5154821f-cfe5-48a8-895e-f9fc37a9e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:02.915056 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 516/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:41:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:03.264459 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1737b5-3868-4740-ad79-fd834ca04916 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:03.278559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1737b5-3868-4740-ad79-fd834ca04916 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:03.283657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:03.284266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:03.284540 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:03.284813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:03.293665 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:03.295290 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fff81-c8a4-4b1b-8c0f-cf2d24d963f6 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:03.305132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 507/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:05.566897 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc6c1-1f2b-4139-abf4-e47d5e6d0826 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:05.567540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc6c1-1f2b-4139-abf4-e47d5e6d0826 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:05.567540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc6c1-1f2b-4139-abf4-e47d5e6d0826 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:05.568779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 517/1024] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:05.574677 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9984-0feb-4186-9741-a71150f6913c None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:05.575174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9984-0feb-4186-9741-a71150f6913c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:05.575174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9984-0feb-4186-9741-a71150f6913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:05.596841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-7e2a9984-0feb-4186-9741-a71150f6913c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:05.598116 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-7e2a9984-0feb-4186-9741-a71150f6913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:05.609678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 508/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:41:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:05.944728 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fc6c1-1f2b-4139-abf4-e47d5e6d0826 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:05.953411 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=95 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:05.962237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fc6c1-1f2b-4139-abf4-e47d5e6d0826 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:05.967617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:05.969339 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:05.972189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:05.972189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:05.981243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:05.983046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4006e0-c261-4e3c-9f1f-12e95e9ac9f5 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:05.992712 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 518/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:15.593006 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=47 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:15.988363 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=5 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:16.045703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629e48-8fff-4f91-8e96-22150d46daf4 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:16.045971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629e48-8fff-4f91-8e96-22150d46daf4 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:16.046251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629e48-8fff-4f91-8e96-22150d46daf4 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:16.047589 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 509/1027] 10.222.0.20 () {54 vars in 918 bytes} [Sat Aug 20 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:41:16.052838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649fe7-955f-4c38-b213-55b6dbf0112b None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:16.053128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649fe7-955f-4c38-b213-55b6dbf0112b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:16.053403 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649fe7-955f-4c38-b213-55b6dbf0112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:16.073435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-0a649fe7-955f-4c38-b213-55b6dbf0112b None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:16.074892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-0a649fe7-955f-4c38-b213-55b6dbf0112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:16.084682 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 519/1028] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Aug 20 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:16.098969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6523e-dd5d-474c-89f6-aa1059c15bc0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:16.099249 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6523e-dd5d-474c-89f6-aa1059c15bc0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:16.099520 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6523e-dd5d-474c-89f6-aa1059c15bc0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:16.100827 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 510/1029] 10.222.0.20 () {54 vars in 918 bytes} [Sat Aug 20 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:16.105573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78709aa-76c4-4a34-aca0-b2cf6d8d479d None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:16.105883 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78709aa-76c4-4a34-aca0-b2cf6d8d479d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:16.106164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78709aa-76c4-4a34-aca0-b2cf6d8d479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:16.127946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f78709aa-76c4-4a34-aca0-b2cf6d8d479d None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:16.129130 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f78709aa-76c4-4a34-aca0-b2cf6d8d479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:16.138832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 520/1030] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Aug 20 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:18.773017 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ee04-8797-48ba-a7fd-37aa3c138cf8 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:18.773974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ee04-8797-48ba-a7fd-37aa3c138cf8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:18.773974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ee04-8797-48ba-a7fd-37aa3c138cf8 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:18.776017 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 511/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:18.783697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e49-b68f-4abb-82fb-81219e910b43 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:18.784133 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e49-b68f-4abb-82fb-81219e910b43 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:18.784247 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e49-b68f-4abb-82fb-81219e910b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:18.812898 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f2ff4e49-b68f-4abb-82fb-81219e910b43 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:18.814145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f2ff4e49-b68f-4abb-82fb-81219e910b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:18.822522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 521/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:19.173173 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ee04-8797-48ba-a7fd-37aa3c138cf8 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:19.189039 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ee04-8797-48ba-a7fd-37aa3c138cf8 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:19.195415 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:19.196041 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:19.196315 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:19.196582 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:19.205230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:19.207185 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819894-d9a8-49fb-a86b-5a86847ee4d4 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:19.216994 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 512/1033] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:20.156919 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f03ce-2f8e-4998-9812-eeba4703f2d9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:20.157373 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f03ce-2f8e-4998-9812-eeba4703f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:20.157487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f03ce-2f8e-4998-9812-eeba4703f2d9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:20.158834 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 522/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:20.164097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a974-3bea-442c-83b0-2ed9ab0a98fa None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:20.164559 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a974-3bea-442c-83b0-2ed9ab0a98fa None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:20.164674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a974-3bea-442c-83b0-2ed9ab0a98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:20.185187 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-cbd2a974-3bea-442c-83b0-2ed9ab0a98fa None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:20.186418 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-cbd2a974-3bea-442c-83b0-2ed9ab0a98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:20.194705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 513/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:20.376088 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f03ce-2f8e-4998-9812-eeba4703f2d9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:20.392915 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f03ce-2f8e-4998-9812-eeba4703f2d9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:20.399065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:20.399665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:20.399943 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:20.400209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:20.410174 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:20.411767 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1680-da0b-4dd5-aae8-d640f18fdafd service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:20.421320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 523/1036] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:21.314000 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3dbcb-aeab-4a25-9d4e-1bb938a1a218 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:21.314585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3dbcb-aeab-4a25-9d4e-1bb938a1a218 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:21.314585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3dbcb-aeab-4a25-9d4e-1bb938a1a218 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:21.315846 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 514/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:21.321194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd21cb-c706-49d8-81c9-e990d793e3f4 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:21.321641 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd21cb-c706-49d8-81c9-e990d793e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:21.321854 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd21cb-c706-49d8-81c9-e990d793e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:21.342689 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-88bd21cb-c706-49d8-81c9-e990d793e3f4 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:21.343892 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-88bd21cb-c706-49d8-81c9-e990d793e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:21.353225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 524/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:21.513361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3dbcb-aeab-4a25-9d4e-1bb938a1a218 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:21.535473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3dbcb-aeab-4a25-9d4e-1bb938a1a218 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:21.544836 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:21.545439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:21.545743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:21.546014 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:21.559169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:21.560854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2036da-b59b-4f32-af05-9c3e9eec70e4 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:21.571978 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 515/1039] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:22.430123 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d8c8-c1fd-4e0a-832a-d6c9a8c44603 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:22.430684 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d8c8-c1fd-4e0a-832a-d6c9a8c44603 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:22.430684 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d8c8-c1fd-4e0a-832a-d6c9a8c44603 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:22.431968 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 525/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:22.437422 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deded9-77d8-40fb-97f1-8ed1b22e3337 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:22.437901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deded9-77d8-40fb-97f1-8ed1b22e3337 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:22.438011 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deded9-77d8-40fb-97f1-8ed1b22e3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:22.461375 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-98deded9-77d8-40fb-97f1-8ed1b22e3337 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:22.462631 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-98deded9-77d8-40fb-97f1-8ed1b22e3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:22.472696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 516/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:22.636103 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d8c8-c1fd-4e0a-832a-d6c9a8c44603 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:22.653162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d8c8-c1fd-4e0a-832a-d6c9a8c44603 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:22.658791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:22.659398 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:22.659673 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:22.659940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:22.668949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:22.670578 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed942-6a3a-4bb2-a211-75df40e5ca83 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:22.680084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 526/1042] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:23.532779 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ead8-e364-4d13-ba60-8c516f0d8433 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:23.533358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ead8-e364-4d13-ba60-8c516f0d8433 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:23.533358 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ead8-e364-4d13-ba60-8c516f0d8433 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:23.534783 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 517/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:23.542665 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848574b0-805b-4ee8-af2a-b88e2a1349c0 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:23.543427 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848574b0-805b-4ee8-af2a-b88e2a1349c0 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:23.543597 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848574b0-805b-4ee8-af2a-b88e2a1349c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:23.574471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-848574b0-805b-4ee8-af2a-b88e2a1349c0 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:23.576194 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-848574b0-805b-4ee8-af2a-b88e2a1349c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:23.585442 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 527/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:23.751104 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ead8-e364-4d13-ba60-8c516f0d8433 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:23.768346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ead8-e364-4d13-ba60-8c516f0d8433 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:23.774778 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:23.775382 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:23.775662 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:23.775930 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:23.784494 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:23.786129 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f8137-1be6-431c-85ce-0dfd98b00b91 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:23.795874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 518/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:24.599432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fc87-6c7a-4036-8925-1e2225432c93 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:24.600332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fc87-6c7a-4036-8925-1e2225432c93 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:24.600332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fc87-6c7a-4036-8925-1e2225432c93 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:24.602536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 528/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:24.607615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a9ea-79f2-4bc6-a38e-a93de655bff1 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:24.608061 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a9ea-79f2-4bc6-a38e-a93de655bff1 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:24.608171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a9ea-79f2-4bc6-a38e-a93de655bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:24.631013 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-0347a9ea-79f2-4bc6-a38e-a93de655bff1 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:24.632226 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-0347a9ea-79f2-4bc6-a38e-a93de655bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:24.641603 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 519/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:24.798557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fc87-6c7a-4036-8925-1e2225432c93 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:24.817057 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fc87-6c7a-4036-8925-1e2225432c93 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:24.822570 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:24.823173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:24.823454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:24.823732 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:24.832865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:24.834502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55546da7-4380-4acb-9b58-a1c9a8736422 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:24.844259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 529/1048] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:25.647316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca83f-02e9-4bfc-a9f7-8c3a3755197f None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:25.648144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca83f-02e9-4bfc-a9f7-8c3a3755197f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:25.648144 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca83f-02e9-4bfc-a9f7-8c3a3755197f None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:25.650197 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 520/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:25.655335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7d53-adcd-442e-bcae-6aa5178c0efc None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:25.655787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7d53-adcd-442e-bcae-6aa5178c0efc None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:25.655878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7d53-adcd-442e-bcae-6aa5178c0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:25.675786 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-c1bc7d53-adcd-442e-bcae-6aa5178c0efc None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:25.676939 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-c1bc7d53-adcd-442e-bcae-6aa5178c0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:25.685569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 530/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:41:25.840332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca83f-02e9-4bfc-a9f7-8c3a3755197f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:25.858114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca83f-02e9-4bfc-a9f7-8c3a3755197f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:25.864433 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:25.865083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:25.865547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:25.866009 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:25.874897 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:25.876508 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bdb86-db83-4d11-9170-63bb86bdb8c0 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:25.885996 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 521/1051] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:26.684657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938bce-456d-48df-8ad6-9470fab39cb0 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:26.685472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938bce-456d-48df-8ad6-9470fab39cb0 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:26.685472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938bce-456d-48df-8ad6-9470fab39cb0 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:26.687596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 531/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:26.692809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6831dd-a76d-4e4f-8a95-78aeacef2676 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:26.693248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6831dd-a76d-4e4f-8a95-78aeacef2676 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:26.693343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6831dd-a76d-4e4f-8a95-78aeacef2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:26.716081 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-cb6831dd-a76d-4e4f-8a95-78aeacef2676 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:26.717313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-cb6831dd-a76d-4e4f-8a95-78aeacef2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:26.726839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 522/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:26.882990 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938bce-456d-48df-8ad6-9470fab39cb0 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:26.899579 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938bce-456d-48df-8ad6-9470fab39cb0 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:26.905322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:26.905959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:26.906233 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:26.906496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:26.914794 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:26.916364 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8ee5b-2929-4684-9af4-2f7af9c987a0 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:26.925888 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 532/1054] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:27.731426 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647dcb-9fb2-420a-b031-ab341dc58ce4 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:27.732318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647dcb-9fb2-420a-b031-ab341dc58ce4 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:27.732318 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647dcb-9fb2-420a-b031-ab341dc58ce4 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:27.734490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 523/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:27.742540 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfcdf-5367-46a9-9eba-4819649cd2e1 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:27.742969 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfcdf-5367-46a9-9eba-4819649cd2e1 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:27.743108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfcdf-5367-46a9-9eba-4819649cd2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:27.765916 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-67dcfcdf-5367-46a9-9eba-4819649cd2e1 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:27.767102 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-67dcfcdf-5367-46a9-9eba-4819649cd2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:27.777214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 533/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:41:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:27.934733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31647dcb-9fb2-420a-b031-ab341dc58ce4 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:27.950817 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31647dcb-9fb2-420a-b031-ab341dc58ce4 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:27.956691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:27.957292 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:27.957555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:27.957857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:27.966025 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:27.967621 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3eb35-f3a8-4ef3-bc06-36f27044a2f3 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:27.976992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 524/1057] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:30.042625 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213510-339d-4d6b-b4ed-a59f8b63b519 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:30.043277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213510-339d-4d6b-b4ed-a59f8b63b519 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:30.043277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213510-339d-4d6b-b4ed-a59f8b63b519 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:30.044557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 534/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:30.051148 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791066a1-d274-4d9d-ab60-633d56cc3b32 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:30.051922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791066a1-d274-4d9d-ab60-633d56cc3b32 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:30.052067 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791066a1-d274-4d9d-ab60-633d56cc3b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:30.076479 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-791066a1-d274-4d9d-ab60-633d56cc3b32 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:30.077677 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-791066a1-d274-4d9d-ab60-633d56cc3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:30.086980 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 525/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:30.430306 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213510-339d-4d6b-b4ed-a59f8b63b519 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:30.445229 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213510-339d-4d6b-b4ed-a59f8b63b519 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:30.451855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:30.452464 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:30.452737 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:30.452999 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:30.463640 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:30.465084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4caf-bdde-4006-aa0b-af571d87f6b9 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:30.474860 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 535/1060] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:32.833256 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007d7b7-b764-4cd4-bf49-19dbb37c2639 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:32.833883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007d7b7-b764-4cd4-bf49-19dbb37c2639 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:32.833883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007d7b7-b764-4cd4-bf49-19dbb37c2639 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:32.835182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 526/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:32.841914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3460f-3f72-4f4e-ac59-f9b501d6d755 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:32.842348 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3460f-3f72-4f4e-ac59-f9b501d6d755 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:32.842461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3460f-3f72-4f4e-ac59-f9b501d6d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:32.871825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-abd3460f-3f72-4f4e-ac59-f9b501d6d755 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:32.873193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-abd3460f-3f72-4f4e-ac59-f9b501d6d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:32.882838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 536/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:33.223619 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007d7b7-b764-4cd4-bf49-19dbb37c2639 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:33.238316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007d7b7-b764-4cd4-bf49-19dbb37c2639 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:33.242133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:33.242749 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:33.243033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:33.243306 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:33.254050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:33.255515 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f05a9-ac68-44f7-bd63-7423817389b6 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:33.264810 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 527/1063] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:41:35.764140 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae17f-8450-4c1e-81c1-e8038dbbdb47 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:35.765065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae17f-8450-4c1e-81c1-e8038dbbdb47 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:35.765065 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae17f-8450-4c1e-81c1-e8038dbbdb47 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:35.767090 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 537/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:35.772902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d5490-98c8-451a-b957-697d0270b096 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:35.773346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d5490-98c8-451a-b957-697d0270b096 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:35.773440 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d5490-98c8-451a-b957-697d0270b096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:35.799420 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-5f6d5490-98c8-451a-b957-697d0270b096 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:35.800611 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-5f6d5490-98c8-451a-b957-697d0270b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:35.808906 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 528/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:36.144360 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae17f-8450-4c1e-81c1-e8038dbbdb47 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:36.156599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae17f-8450-4c1e-81c1-e8038dbbdb47 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:36.160508 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:36.161114 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:36.161393 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:36.161690 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:36.171293 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:36.172761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0a3a6-16cb-43eb-84fd-ad03b8c8246f service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:36.182448 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 538/1066] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:38.472450 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dca1f-8788-4f88-bdc1-5e613286ecb0 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:38.473028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dca1f-8788-4f88-bdc1-5e613286ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:38.473028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dca1f-8788-4f88-bdc1-5e613286ecb0 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:38.475122 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 529/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:38.483720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cf49-8f8d-4c13-8447-cb6da4cded0e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:38.484163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cf49-8f8d-4c13-8447-cb6da4cded0e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:38.484267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cf49-8f8d-4c13-8447-cb6da4cded0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:38.513813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-b405cf49-8f8d-4c13-8447-cb6da4cded0e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:38.515003 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b405cf49-8f8d-4c13-8447-cb6da4cded0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:38.524012 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 539/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:38.866923 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dca1f-8788-4f88-bdc1-5e613286ecb0 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:38.878902 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dca1f-8788-4f88-bdc1-5e613286ecb0 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:38.882530 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:38.883131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:38.883404 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:38.883672 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:38.892538 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:38.894026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21b3b5-30e6-41e1-9388-391af74114e9 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:38.903886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 530/1069] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:41:41.115028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1932a-3a6c-40bd-bd83-2c0a6e79189b None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:41.115595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1932a-3a6c-40bd-bd83-2c0a6e79189b None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:41.115595 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1932a-3a6c-40bd-bd83-2c0a6e79189b None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:41.117662 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 540/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:41.124964 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75093545-e9bc-4c3f-b35b-83e134fe5b4f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:41.125379 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75093545-e9bc-4c3f-b35b-83e134fe5b4f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:41.125548 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75093545-e9bc-4c3f-b35b-83e134fe5b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:41.147132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-75093545-e9bc-4c3f-b35b-83e134fe5b4f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:41.148338 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-75093545-e9bc-4c3f-b35b-83e134fe5b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:41.158120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 531/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:41.498325 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1932a-3a6c-40bd-bd83-2c0a6e79189b None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:41.515911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1932a-3a6c-40bd-bd83-2c0a6e79189b None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:41.520064 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:41.520669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:41.520940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:41.521224 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:41.530034 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:41.531511 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808f473-7502-44f4-861c-6c0ab0b842fc service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:41.540668 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 541/1072] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:43.730509 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4ec6-f05f-4c16-97b9-666c2215b9a5 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:43.731192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4ec6-f05f-4c16-97b9-666c2215b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:43.731192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4ec6-f05f-4c16-97b9-666c2215b9a5 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:43.732473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 532/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:43.739054 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb04c4-57e8-4982-8744-630ca54f0201 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:43.739826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb04c4-57e8-4982-8744-630ca54f0201 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:43.740000 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb04c4-57e8-4982-8744-630ca54f0201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:43.768333 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-a9cb04c4-57e8-4982-8744-630ca54f0201 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:43.769512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-a9cb04c4-57e8-4982-8744-630ca54f0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:43.778760 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 542/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:44.115499 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4ec6-f05f-4c16-97b9-666c2215b9a5 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:44.129770 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4ec6-f05f-4c16-97b9-666c2215b9a5 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:44.134120 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:44.134824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:44.135105 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:44.135375 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:44.145771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:44.147251 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f154300-a54a-4d85-b86c-93aa1c3e5970 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:44.157259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 533/1075] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:46.378132 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200155f9-a54d-45a8-8370-ab6b6594c8a9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:46.378693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200155f9-a54d-45a8-8370-ab6b6594c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:46.378693 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200155f9-a54d-45a8-8370-ab6b6594c8a9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:46.380015 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 543/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:46.386281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea707-6f50-404b-bf09-c3805772ac58 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:46.386702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea707-6f50-404b-bf09-c3805772ac58 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:46.386834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea707-6f50-404b-bf09-c3805772ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:46.398916 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=70 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:46.413657 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-8eeea707-6f50-404b-bf09-c3805772ac58 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:46.414844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-8eeea707-6f50-404b-bf09-c3805772ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:46.423553 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 534/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:46.763395 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200155f9-a54d-45a8-8370-ab6b6594c8a9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:46.772543 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=73 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:41:46.783028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200155f9-a54d-45a8-8370-ab6b6594c8a9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:46.789525 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:46.790467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:46.790855 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:46.791202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:46.801342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:46.802825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d528f-85ac-41f8-96b8-82f56220c2d9 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:46.812261 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 544/1078] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:49.013111 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb54-82bf-4436-8739-8f9cbdb209f3 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:49.013636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb54-82bf-4436-8739-8f9cbdb209f3 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:49.013636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb54-82bf-4436-8739-8f9cbdb209f3 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:49.015029 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 535/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:49.020507 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e763-31f9-4dc9-a0e8-07b16b000285 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:49.020958 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e763-31f9-4dc9-a0e8-07b16b000285 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:49.021051 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e763-31f9-4dc9-a0e8-07b16b000285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:49.041362 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f6a7e763-31f9-4dc9-a0e8-07b16b000285 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:49.042592 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f6a7e763-31f9-4dc9-a0e8-07b16b000285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:49.051512 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 545/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:49.382068 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5bb54-82bf-4436-8739-8f9cbdb209f3 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:49.402409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5bb54-82bf-4436-8739-8f9cbdb209f3 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:49.406968 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:49.407576 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:49.407857 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:49.408128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:49.417594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:49.419077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c569ea-7fef-40ea-a38c-4e13026bd29f service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:49.428737 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 536/1081] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:51.585155 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f030-6255-474b-a9fd-504848e7a46a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:51.585733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f030-6255-474b-a9fd-504848e7a46a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:51.585733 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f030-6255-474b-a9fd-504848e7a46a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:51.587009 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 546/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:51.593334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73dea1-cd3a-419d-9c3c-b9625be2edaa None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:51.594075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73dea1-cd3a-419d-9c3c-b9625be2edaa None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:51.594182 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73dea1-cd3a-419d-9c3c-b9625be2edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:51.623654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-cc73dea1-cd3a-419d-9c3c-b9625be2edaa None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:51.624849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-cc73dea1-cd3a-419d-9c3c-b9625be2edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:51.634176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 537/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:51.966538 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2f030-6255-474b-a9fd-504848e7a46a None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:51.983267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2f030-6255-474b-a9fd-504848e7a46a None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:51.987454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:51.988067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:51.988350 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:51.988622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:51.998491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:51.999940 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2022-0dd7-45d1-867f-cceea7d3733d service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:52.009400 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 547/1084] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:41:54.155612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa25a3-9576-444f-8b29-083c2e0f370c None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:54.156039 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa25a3-9576-444f-8b29-083c2e0f370c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:54.156137 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa25a3-9576-444f-8b29-083c2e0f370c None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:54.157568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 538/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:41:54.164073 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bd62-6010-4cb0-9a3c-38ddbbe568eb None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:54.164511 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bd62-6010-4cb0-9a3c-38ddbbe568eb None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:54.164606 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bd62-6010-4cb0-9a3c-38ddbbe568eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:54.192169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-3c88bd62-6010-4cb0-9a3c-38ddbbe568eb None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:41:54.193377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-3c88bd62-6010-4cb0-9a3c-38ddbbe568eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:41:54.202622 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 548/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:41:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:41:54.537988 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa25a3-9576-444f-8b29-083c2e0f370c None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:41:54.552789 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa25a3-9576-444f-8b29-083c2e0f370c None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:41:54.556651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:41:54.557259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:41:54.557561 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:41:54.557855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:41:54.567231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:41:54.568683 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a2dd-b429-45b5-b3c0-1baae61756c7 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:41:54.577922 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 539/1087] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:41:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:04.186975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=17 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:42:04.573936 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=17 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:42:18.050536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98c8a-b119-4a84-9812-0110fcb69380 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:18.051430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98c8a-b119-4a84-9812-0110fcb69380 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:18.051430 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98c8a-b119-4a84-9812-0110fcb69380 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:18.053264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 549/1088] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:18.060170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6cf40-8b5c-4ad1-ab27-e480f76071d9 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:18.060604 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6cf40-8b5c-4ad1-ab27-e480f76071d9 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:18.060745 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6cf40-8b5c-4ad1-ab27-e480f76071d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:18.087529 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-49d6cf40-8b5c-4ad1-ab27-e480f76071d9 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:18.089354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-49d6cf40-8b5c-4ad1-ab27-e480f76071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:18.097929 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 540/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:18.457260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fce6-e022-43f9-a5ed-961c6a2cc0f7 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:18.457547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fce6-e022-43f9-a5ed-961c6a2cc0f7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:18.457842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fce6-e022-43f9-a5ed-961c6a2cc0f7 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:18.459201 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 550/1090] 10.222.0.20 () {54 vars in 967 bytes} [Sat Aug 20 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:18.464474 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb8ff-54c0-46e6-9f6b-711b53082c37 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:18.464757 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb8ff-54c0-46e6-9f6b-711b53082c37 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:18.465030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb8ff-54c0-46e6-9f6b-711b53082c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:18.485463 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-92cdb8ff-54c0-46e6-9f6b-711b53082c37 None None] MFA Rules not processed for user `ed64374e93484949aeca834b88b14e42`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:18.486686 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-92cdb8ff-54c0-46e6-9f6b-711b53082c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:18.493644 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 541/1091] 10.222.0.20 () {58 vars in 1064 bytes} [Sat Aug 20 20:42:18 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:18.501072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fce6-e022-43f9-a5ed-961c6a2cc0f7 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:18.513824 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fce6-e022-43f9-a5ed-961c6a2cc0f7 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:18.518193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed64374e93484949aeca834b88b14e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:18.518781 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:18.519058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:18.519327 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:18.528361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:18.529806 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee964ea-5ae6-4c58-b22d-7e1138b5e32b service glance] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:18.539344 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 551/1092] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:20.765407 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921b5b-6ce9-4131-8e3b-1bce96379771 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:20.766322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921b5b-6ce9-4131-8e3b-1bce96379771 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:20.766322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921b5b-6ce9-4131-8e3b-1bce96379771 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:20.768524 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 542/1093] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:20.774872 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635be3-786b-4aec-baa6-34561d2e09c9 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:20.775599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635be3-786b-4aec-baa6-34561d2e09c9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:20.775779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635be3-786b-4aec-baa6-34561d2e09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:20.800856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-74635be3-786b-4aec-baa6-34561d2e09c9 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:20.802100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-74635be3-786b-4aec-baa6-34561d2e09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:20.810655 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 552/1094] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:21.130235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921b5b-6ce9-4131-8e3b-1bce96379771 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:21.151369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921b5b-6ce9-4131-8e3b-1bce96379771 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:21.156000 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:21.156608 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:21.156884 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:21.157153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:21.157831 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:21.159600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:42:21.159600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:42:21.159600 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:42:21.160728 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba20ce-b628-41bd-80df-93ce45bc1594 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:21.179286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 543/1095] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Aug 20 20:42:21 2022] GET /identity/v3/projects => generated 1606 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:42:23.328204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb81b-4967-47ed-ad25-ecf4fa5b63ba None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:23.328661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb81b-4967-47ed-ad25-ecf4fa5b63ba None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:23.328759 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb81b-4967-47ed-ad25-ecf4fa5b63ba None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:23.330644 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 553/1096] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:23.338266 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ebf5-ba0b-4b8d-a4be-4ac8cec167d2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:23.339245 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ebf5-ba0b-4b8d-a4be-4ac8cec167d2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:23.339523 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ebf5-ba0b-4b8d-a4be-4ac8cec167d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:23.359401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-94a3ebf5-ba0b-4b8d-a4be-4ac8cec167d2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:23.360612 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-94a3ebf5-ba0b-4b8d-a4be-4ac8cec167d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:23.370337 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 544/1097] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:23.733193 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb81b-4967-47ed-ad25-ecf4fa5b63ba None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:23.748315 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb81b-4967-47ed-ad25-ecf4fa5b63ba None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:23.754265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:23.754870 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:23.755151 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:23.755424 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:23.763799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:23.765396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac0d6-266c-46ed-aea3-6c6aa0f98ff4 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:23.774873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 554/1098] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:26.089651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470af-c8a1-424b-927a-c4d7f7edcf85 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:26.090267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470af-c8a1-424b-927a-c4d7f7edcf85 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:26.090267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470af-c8a1-424b-927a-c4d7f7edcf85 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:26.091580 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 545/1099] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:26.097225 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba6b3-f724-49a1-8022-677a1e1470ff None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:26.097666 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba6b3-f724-49a1-8022-677a1e1470ff None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:26.097817 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba6b3-f724-49a1-8022-677a1e1470ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:26.123695 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e00ba6b3-f724-49a1-8022-677a1e1470ff None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:26.124948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e00ba6b3-f724-49a1-8022-677a1e1470ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:26.133572 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 555/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:26.467805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967470af-c8a1-424b-927a-c4d7f7edcf85 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:26.483490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967470af-c8a1-424b-927a-c4d7f7edcf85 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:26.487547 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:26.488151 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:26.488441 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:26.488708 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:26.497641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:26.499113 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4927075-e453-4c80-8418-cf0ccf7cd56d service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:26.508235 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 546/1101] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:28.705960 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4a9-50ba-46e7-9aae-2aaec8e9d049 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:28.706546 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4a9-50ba-46e7-9aae-2aaec8e9d049 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:28.706546 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4a9-50ba-46e7-9aae-2aaec8e9d049 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:28.708628 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 556/1102] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:28.716738 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccaacb-a8c7-4796-81d2-8a1555586a63 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:28.717220 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccaacb-a8c7-4796-81d2-8a1555586a63 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:28.717313 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccaacb-a8c7-4796-81d2-8a1555586a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:28.737660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-eeccaacb-a8c7-4796-81d2-8a1555586a63 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:28.738863 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-eeccaacb-a8c7-4796-81d2-8a1555586a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:28.747175 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 547/1103] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:42:29.088548 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d4a9-50ba-46e7-9aae-2aaec8e9d049 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:29.101903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d4a9-50ba-46e7-9aae-2aaec8e9d049 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:29.106347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:29.106948 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:29.107226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:29.107498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:29.117068 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:29.118594 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c45f-021c-4822-8b88-0421fedbaddf service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:29.128120 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 557/1104] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:31.342088 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b9ce-fab1-4a1f-a1db-3c84b5537c7b None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:31.342615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b9ce-fab1-4a1f-a1db-3c84b5537c7b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:31.342615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b9ce-fab1-4a1f-a1db-3c84b5537c7b None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:31.343965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 548/1105] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:31.350297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffeb8e-f4b4-48d7-af1f-1138bb93fb2e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:31.350761 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffeb8e-f4b4-48d7-af1f-1138bb93fb2e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:31.350863 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffeb8e-f4b4-48d7-af1f-1138bb93fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:31.377277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-15ffeb8e-f4b4-48d7-af1f-1138bb93fb2e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:31.378518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-15ffeb8e-f4b4-48d7-af1f-1138bb93fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:31.387240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 558/1106] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:31.732919 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76b9ce-fab1-4a1f-a1db-3c84b5537c7b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:31.750503 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76b9ce-fab1-4a1f-a1db-3c84b5537c7b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:31.756324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:31.757230 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:31.757681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:31.758098 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:31.768383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:31.769855 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bfded-d1b7-4fb2-b768-0dbe3b98acf7 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:31.779551 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 549/1107] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:34.121163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b9-a5d9-41a1-9dfe-80d6037e9693 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:34.122164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b9-a5d9-41a1-9dfe-80d6037e9693 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:34.122164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b9-a5d9-41a1-9dfe-80d6037e9693 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:34.124232 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 559/1108] 10.222.0.20 () {54 vars in 927 bytes} [Sat Aug 20 20:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:42:34.133308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb535-621a-4fb8-888c-cebf59649c6b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:34.134089 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb535-621a-4fb8-888c-cebf59649c6b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:34.134287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb535-621a-4fb8-888c-cebf59649c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:34.154733 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-309eb535-621a-4fb8-888c-cebf59649c6b None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:42:34.155972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-309eb535-621a-4fb8-888c-cebf59649c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:42:34.166134 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 550/1109] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Aug 20 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:42:34.510773 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed507b9-a5d9-41a1-9dfe-80d6037e9693 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:42:34.527965 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed507b9-a5d9-41a1-9dfe-80d6037e9693 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:42:34.531841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:42:34.532542 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:42:34.532816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:42:34.533091 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:42:34.543272 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:42:34.544715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853c11d-51d0-4947-9b56-3c23f08d7013 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:42:34.555117 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 560/1110] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:42:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:42:44.149565 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=33 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:42:44.550146 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=33 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:43:54.196028 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.196658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.196658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.226954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:43:54.228199 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:54.236838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 551/1111] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:43:54.245128 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.245697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.245697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.265632 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:43:54.266837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:54.276081 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 561/1112] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:43:54.280742 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.290702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac56a9-39c9-41a0-90de-db593413573e None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.295813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.296410 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.296696 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.296974 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.297654 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:43:54.297956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.298973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.298973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:43:54.298973 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:43:54.299850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.311709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 552/1113] 10.222.0.20 () {58 vars in 1153 bytes} [Sat Aug 20 20:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:43:54.319838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.329876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80402951-7d66-4465-899a-f87d9eced2e7 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.335566 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.336184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.336518 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.336791 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.337416 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.339331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.339331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:43:54.339331 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:43:54.340565 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.369648 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 562/1114] 10.222.0.20 () {60 vars in 1153 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:43:54.373952 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.384090 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a43e2-207e-4659-948a-fe448b30463b admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.447794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.448473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.448744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.449115 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.449768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.450799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.450799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:43:54.450799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:43:54.452003 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.476446 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 553/1115] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:43:54.480795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.491175 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353a92-e95f-480c-9590-3bf43473cfa2 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.497039 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.497702 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.497978 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.498243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.498902 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.499924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.499924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:43:54.499924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:43:54.500807 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.513868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 563/1116] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:43:54.518424 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.534229 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4505d7-8d3b-4b08-b517-14d44a926097 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.541825 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.542481 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.542768 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.543040 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.543735 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.544812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.544812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:43:54.544812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:43:54.545727 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20057e87-ebaa-421f-aa3b-08fb12b04a72 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.559441 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 554/1117] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:43:54.563588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.574136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c702947-cb7c-45c7-88e1-08067e5f3c69 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.580591 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.581245 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.581517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.581816 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] PATH_INFO: `/v3/projects/f62aa779107d4456bb48c03bf0eb91e1/users/01af88cf14564fbcb771919bc969ccf0/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.596886 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62aa779107d4456bb48c03bf0eb91e1, user_id=01af88cf14564fbcb771919bc969ccf0, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.597959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:54.597959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:43:54.597959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:43:54.599873 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd41bd4-e068-4022-9f8f-ab6fde101c32 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.615196 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 564/1118] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:43:54 2022] PUT /identity/v3/projects/f62aa779107d4456bb48c03bf0eb91e1/users/01af88cf14564fbcb771919bc969ccf0/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:43:54.633386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bd90a-11e0-4055-9f78-988e9739f3da None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.633791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bd90a-11e0-4055-9f78-988e9739f3da None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.634071 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bd90a-11e0-4055-9f78-988e9739f3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.670693 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f33bd90a-11e0-4055-9f78-988e9739f3da None None] MFA Rules not processed for user `01af88cf14564fbcb771919bc969ccf0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:43:54.672568 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f33bd90a-11e0-4055-9f78-988e9739f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:54.742030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 555/1119] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:43:54.756945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148dfe-1c50-4fe5-8001-a12136664fd9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.757238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148dfe-1c50-4fe5-8001-a12136664fd9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.757467 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148dfe-1c50-4fe5-8001-a12136664fd9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.758962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 565/1120] 10.222.0.20 () {54 vars in 964 bytes} [Sat Aug 20 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:43:54.765519 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc9b6-f779-47ce-8154-163b9b3c1a69 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.765838 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc9b6-f779-47ce-8154-163b9b3c1a69 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.766369 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc9b6-f779-47ce-8154-163b9b3c1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.789413 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a31bc9b6-f779-47ce-8154-163b9b3c1a69 None None] MFA Rules not processed for user `032ee4c6594a4085899e30d2e96bb783`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:43:54.790669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a31bc9b6-f779-47ce-8154-163b9b3c1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:54.836691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:43:54.846103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 556/1121] 10.222.0.20 () {58 vars in 1061 bytes} [Sat Aug 20 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:43:54.853903 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95148dfe-1c50-4fe5-8001-a12136664fd9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:54.867098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95148dfe-1c50-4fe5-8001-a12136664fd9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:54.870992 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '032ee4c6594a4085899e30d2e96bb783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:54.871588 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.871866 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.872136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.880650 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:54.882392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:54.892534 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 566/1122] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:43:54 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:43:54.930542 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a5c-b44e-4a83-b5b4-a0ff7dba3199 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:54.930830 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a5c-b44e-4a83-b5b4-a0ff7dba3199 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:54.931103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a5c-b44e-4a83-b5b4-a0ff7dba3199 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:54.932371 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 557/1123] 10.222.0.20 () {52 vars in 830 bytes} [Sat Aug 20 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:43:54.935975 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:55.001358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499d0-db77-4fff-b9de-60ad150e40d9 service cinder] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:55.009510 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:55.010192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:55.010472 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:55.010747 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] PATH_INFO: `/v3/users/01af88cf14564fbcb771919bc969ccf0` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:55.012040 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01af88cf14564fbcb771919bc969ccf0)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:55.013095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:55.013095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:43:55.013095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:43:55.014358 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:55.091517 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01af88cf14564fbcb771919bc969ccf0'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.092274 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01af88cf14564fbcb771919bc969ccf0'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.104086 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01af88cf14564fbcb771919bc969ccf0'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.104799 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01af88cf14564fbcb771919bc969ccf0'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.118568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01af88cf14564fbcb771919bc969ccf0'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.146372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 567/1124] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Aug 20 20:43:54 2022] DELETE /identity/v3/users/01af88cf14564fbcb771919bc969ccf0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:43:55.151045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:55.151329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:55.151620 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:55.170291 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:43:55.171473 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:55.232856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 558/1125] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:43:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:43:55.242813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:55.244323 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:55.250202 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:43:55.305482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2e90-a454-4374-8e9a-4c166db9873b admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:55.310047 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:55.310652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:55.310934 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:55.311212 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:55.321104 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:55.322603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d911c4-cc91-4dda-b357-5d10bcee00aa service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:55.332977 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 568/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:43:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:43:55.695651 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:43:55.697143 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:43:55.710578 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4ffa-f17d-45c9-a172-801bf5094f32 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:43:55.717632 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:43:55.718308 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:43:55.718587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:43:55.718856 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] PATH_INFO: `/v3/projects/f62aa779107d4456bb48c03bf0eb91e1` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:43:55.720112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62aa779107d4456bb48c03bf0eb91e1)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:43:55.722075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:43:55.722075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:43:55.722075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:43:55.723656 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:43:55.786726 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62aa779107d4456bb48c03bf0eb91e1', 'request_id': 'req-1f88003f-7801-404c-9545-19ea4ea40b14'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.798582 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62aa779107d4456bb48c03bf0eb91e1', 'request_id': 'req-1f88003f-7801-404c-9545-19ea4ea40b14'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.812059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62aa779107d4456bb48c03bf0eb91e1', 'request_id': 'req-1f88003f-7801-404c-9545-19ea4ea40b14'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.822955 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] The token cache is being invalidate because project f62aa779107d4456bb48c03bf0eb91e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 20 20:43:55.823241 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.823903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-1f88003f-7801-404c-9545-19ea4ea40b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:43:55.825512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 559/1127] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Aug 20 20:43:55 2022] DELETE /identity/v3/projects/f62aa779107d4456bb48c03bf0eb91e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:44:05.328504 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=25 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:44:05.820070 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:45:12.388127 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:12.389005 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:12.389005 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:12.391366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 569/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:45:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:12.397155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bb8c-4ccd-4a42-a5b6-10557bca5c11 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:12.398008 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bb8c-4ccd-4a42-a5b6-10557bca5c11 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:12.398194 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bb8c-4ccd-4a42-a5b6-10557bca5c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:12.476775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a702bb8c-4ccd-4a42-a5b6-10557bca5c11 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:12.478033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a702bb8c-4ccd-4a42-a5b6-10557bca5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:12.577381 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 560/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:45:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:12.738022 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:12.740105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:12.833335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977d4c5-f6a3-431d-b568-f71fc3b7848a None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:12.838292 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:12.838908 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:12.839188 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:12.839458 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:12.847730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:12.849321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9154d40-285d-4cfc-8d8e-a344f8d70c38 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:12.858685 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 570/1130] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:13.682131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7158-ad14-4b68-a325-cf05d4836f85 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:13.682971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7158-ad14-4b68-a325-cf05d4836f85 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:13.682971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7158-ad14-4b68-a325-cf05d4836f85 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:13.685121 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 561/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:13.691184 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eabd03-15b6-4bfe-96a3-e41fe890ea5c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:13.691946 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eabd03-15b6-4bfe-96a3-e41fe890ea5c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:13.692124 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eabd03-15b6-4bfe-96a3-e41fe890ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:13.716459 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-99eabd03-15b6-4bfe-96a3-e41fe890ea5c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:13.717716 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-99eabd03-15b6-4bfe-96a3-e41fe890ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:13.726418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 571/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:45:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:13.894190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7158-ad14-4b68-a325-cf05d4836f85 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:13.916907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7158-ad14-4b68-a325-cf05d4836f85 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:13.922636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:13.923232 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:13.923512 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:13.923781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:13.932761 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:13.934334 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a61f-daf2-43dc-a591-b6086d6f6a30 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:13.943874 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 562/1133] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:18.787388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c815-8fd9-41db-b79c-5e3776cce280 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:18.787964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c815-8fd9-41db-b79c-5e3776cce280 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:18.787964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c815-8fd9-41db-b79c-5e3776cce280 None None] PATH_INFO: `/v3` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:18.789208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 572/1134] 10.222.0.17 () {54 vars in 925 bytes} [Sat Aug 20 20:45:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 20 20:45:18.799649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f9b31-4a64-420d-96f8-ae8755c6c4e0 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:18.800097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f9b31-4a64-420d-96f8-ae8755c6c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:18.800200 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f9b31-4a64-420d-96f8-ae8755c6c4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:18.831892 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-7c3f9b31-4a64-420d-96f8-ae8755c6c4e0 None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:18.833119 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-7c3f9b31-4a64-420d-96f8-ae8755c6c4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:18.888824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:45:18.899912 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 563/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 20 20:45:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:23.178720 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f969-b0e8-4bc8-b7f2-572cd18556e2 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:23.179573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f969-b0e8-4bc8-b7f2-572cd18556e2 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:23.179573 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f969-b0e8-4bc8-b7f2-572cd18556e2 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:23.180772 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 573/1136] 10.222.0.20 () {54 vars in 961 bytes} [Sat Aug 20 20:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:23.186972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068400d-0415-4a96-84e4-f10336cec84a None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:23.187442 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068400d-0415-4a96-84e4-f10336cec84a None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:23.187586 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068400d-0415-4a96-84e4-f10336cec84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:23.215518 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-d068400d-0415-4a96-84e4-f10336cec84a None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:23.216734 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-d068400d-0415-4a96-84e4-f10336cec84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:23.226616 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 564/1137] 10.222.0.20 () {58 vars in 1058 bytes} [Sat Aug 20 20:45:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:23.234219 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f969-b0e8-4bc8-b7f2-572cd18556e2 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:23.249060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f969-b0e8-4bc8-b7f2-572cd18556e2 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:23.254370 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:23.254963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:23.255238 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:23.255509 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:23.263585 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:23.265172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc076d-e827-432a-92e2-b1f3406b6c70 service placement] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:23.274492 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 574/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:25.196894 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea462b-1a4b-4550-bc7d-44cb69fd3641 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:25.197490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea462b-1a4b-4550-bc7d-44cb69fd3641 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:25.197490 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea462b-1a4b-4550-bc7d-44cb69fd3641 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:25.198799 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:25.208243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759729-09cc-4dcb-8d6e-7cfbdd4708fa None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:25.208963 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759729-09cc-4dcb-8d6e-7cfbdd4708fa None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:25.209145 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759729-09cc-4dcb-8d6e-7cfbdd4708fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:25.235205 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-14759729-09cc-4dcb-8d6e-7cfbdd4708fa None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:25.236402 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-14759729-09cc-4dcb-8d6e-7cfbdd4708fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:25.245980 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:45:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:25.404610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea462b-1a4b-4550-bc7d-44cb69fd3641 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:25.425814 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea462b-1a4b-4550-bc7d-44cb69fd3641 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:25.432296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:25.432903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:25.433183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:25.433454 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:25.442345 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:25.443943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c79661-bb1f-4259-9760-74e66ec2a082 service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:25.454403 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 566/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:26.284209 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04857a-ed88-43cd-84fa-4c34ac7b96e8 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:26.284924 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04857a-ed88-43cd-84fa-4c34ac7b96e8 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:26.285076 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04857a-ed88-43cd-84fa-4c34ac7b96e8 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:26.287429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 576/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 20 20:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:26.293323 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f95c-3e12-4bc6-ae38-cbbf567b7c1f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:26.294132 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f95c-3e12-4bc6-ae38-cbbf567b7c1f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:26.294320 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f95c-3e12-4bc6-ae38-cbbf567b7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:26.318987 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-b138f95c-3e12-4bc6-ae38-cbbf567b7c1f None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:26.320201 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-b138f95c-3e12-4bc6-ae38-cbbf567b7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:26.333532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 567/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 20 20:45:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:26.493280 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04857a-ed88-43cd-84fa-4c34ac7b96e8 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:26.509307 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04857a-ed88-43cd-84fa-4c34ac7b96e8 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:26.514841 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:26.515440 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:26.515717 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:26.515996 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:26.524372 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:26.526072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1037c4-856b-4d95-9cf7-527a61f9c0e0 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:26.535279 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 577/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:30.519966 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d558e-2324-43e5-b942-65b896412b66 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:30.520555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d558e-2324-43e5-b942-65b896412b66 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:30.520555 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d558e-2324-43e5-b942-65b896412b66 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:30.522771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:45:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:30.531473 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b810-54c9-48a1-b107-8f5b1066289c None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:30.532206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b810-54c9-48a1-b107-8f5b1066289c None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:30.532206 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b810-54c9-48a1-b107-8f5b1066289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:30.560564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-0429b810-54c9-48a1-b107-8f5b1066289c None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:30.561795 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-0429b810-54c9-48a1-b107-8f5b1066289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:30.570979 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:45:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:30.913771 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d558e-2324-43e5-b942-65b896412b66 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:30.915956 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-125d558e-2324-43e5-b942-65b896412b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:30.975937 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d558e-2324-43e5-b942-65b896412b66 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:30.982641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:30.983433 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:30.983710 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:30.984012 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:30.999746 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:31.002035 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388964-580b-406f-bb40-6006561f63f4 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:31.013641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 569/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:33.129921 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1295a-4fbb-41be-851e-e9789ed2d5fa None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:33.130529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1295a-4fbb-41be-851e-e9789ed2d5fa None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:33.130529 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1295a-4fbb-41be-851e-e9789ed2d5fa None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:33.131779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 579/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:33.137362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddb4-3bc5-4160-a7da-6c7fec55a270 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:33.137837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddb4-3bc5-4160-a7da-6c7fec55a270 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:33.137949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddb4-3bc5-4160-a7da-6c7fec55a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:33.157660 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-5c85ddb4-3bc5-4160-a7da-6c7fec55a270 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:33.158844 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-5c85ddb4-3bc5-4160-a7da-6c7fec55a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:33.172252 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 570/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:45:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:33.510853 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1295a-4fbb-41be-851e-e9789ed2d5fa None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:33.526840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1295a-4fbb-41be-851e-e9789ed2d5fa None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:33.530752 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:33.531351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:33.531630 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:33.531902 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:33.542235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:33.543681 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ed7bd-d238-42cc-83fe-400f136c0936 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:33.555016 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 580/1150] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:37.273892 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:37.274858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:37.274858 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:37.277072 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 571/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:45:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:37.282583 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7c91-910f-409b-9de1-c0e04043bb57 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:37.283037 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7c91-910f-409b-9de1-c0e04043bb57 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:37.283137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7c91-910f-409b-9de1-c0e04043bb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:37.291663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=67 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:45:37.305651 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-8c0b7c91-910f-409b-9de1-c0e04043bb57 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:37.306876 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-8c0b7c91-910f-409b-9de1-c0e04043bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:37.315869 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 581/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:45:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:37.886941 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:37.889321 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:37.962505 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcda9a4-a2d3-4141-90cc-95757f367ed7 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:37.966972 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '032ee4c6594a4085899e30d2e96bb783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:37.967626 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:37.967904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:37.968172 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:37.978588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:37.980054 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5ab6-b638-461b-8300-1a7da637e49b service cinder] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:37.989711 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 572/1153] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:40.171697 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:40.172322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:40.172322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:40.173597 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 582/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 20 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:45:40.179992 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cd0a5-2ab1-4f7a-8bf8-d666b1f3685e None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:40.180702 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cd0a5-2ab1-4f7a-8bf8-d666b1f3685e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:40.180832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cd0a5-2ab1-4f7a-8bf8-d666b1f3685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:40.207376 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-699cd0a5-2ab1-4f7a-8bf8-d666b1f3685e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:45:40.209406 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-699cd0a5-2ab1-4f7a-8bf8-d666b1f3685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:40.218885 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 573/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 20 20:45:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:45:40.777555 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:45:40.779652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:45:40.793925 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33caac4-8ff0-4267-a677-4d11d9b62866 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:45:40.798617 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '032ee4c6594a4085899e30d2e96bb783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:45:40.799229 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:45:40.799509 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:45:40.799779 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:45:40.809951 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:45:40.811407 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ce0d-ef70-4fdb-8fd5-62c7aeb3e859 service cinder] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:45:40.821493 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 583/1156] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:45:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:45:50.201584 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=70 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:45:50.817317 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=8 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:53.023167 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978738-9260-4f03-acf4-8a3236a2913d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.024246 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978738-9260-4f03-acf4-8a3236a2913d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.024537 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978738-9260-4f03-acf4-8a3236a2913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.038933 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f62a-bf7d-432d-a1a0-c6ad7b680458 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.039483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f62a-bf7d-432d-a1a0-c6ad7b680458 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.039483 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f62a-bf7d-432d-a1a0-c6ad7b680458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.045924 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-94978738-9260-4f03-acf4-8a3236a2913d None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.047191 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-94978738-9260-4f03-acf4-8a3236a2913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.055737 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 574/1157] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:46:53.059356 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-4b88f62a-bf7d-432d-a1a0-c6ad7b680458 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.060528 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-4b88f62a-bf7d-432d-a1a0-c6ad7b680458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.063971 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.064259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.064704 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.068661 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 584/1158] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:46:53.076859 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.077137 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.077409 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.083969 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.085202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.093328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 575/1159] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:46:53.096436 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.097722 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.097837 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.105405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 585/1160] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:46:53.106572 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99d09-2fdb-4fd7-8ace-37ae9f5920b2 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.109850 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.111209 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.111829 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.112109 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.112384 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.113021 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:46:53.113328 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.115047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.119189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c395-3eb4-43e7-aada-6b17c737eb04 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.124163 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.124744 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.125022 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.125292 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] PATH_INFO: `/v3/domains` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.125964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 20 20:46:53.126264 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.126704 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 576/1161] 10.222.0.20 () {58 vars in 1153 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:46:53.127413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:46:53.127413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:46:53.127413 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:46:53.128259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.134595 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.140236 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 586/1162] 10.222.0.20 () {58 vars in 1153 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 20 20:46:53.144046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0c486-bfc1-460f-bf03-4e1719993d82 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.148042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.148717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.149329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.149610 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.149921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.150535 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.151558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:46:53.151558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:46:53.151558 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:46:53.152736 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.157994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d3a55-7d92-483a-9948-d873573da979 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.162643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.163243 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.163611 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.163858 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.164496 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.166404 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.192401 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 577/1163] 10.222.0.20 () {60 vars in 1153 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:46:53.195765 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 587/1164] 10.222.0.20 () {60 vars in 1153 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:46:53.196824 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.197918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.258141 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f07e9-8860-4e3d-aedc-e3a0ca788f48 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.258694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf343-e54c-41f6-91f1-2abb23192ee5 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.263022 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.263221 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.263666 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.263825 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.263970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.264095 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.264341 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.264452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.265018 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.265167 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.266208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:46:53.266208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:46:53.266208 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:46:53.266970 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.267401 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.290279 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 578/1165] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:46:53.293653 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 588/1166] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:46:53.294286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.296619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.304275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087f60-832c-44c3-8cca-dda49b899fa4 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.306049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe865e2-77b6-441a-aa44-c747f00749b6 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.309203 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.309832 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.310122 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.310393 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.311033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.312647 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.314451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.315060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.315341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.315614 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.316262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.317911 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.326316 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 579/1167] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:46:53.330722 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.331856 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 589/1168] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:46:53.335701 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.340905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc605d1-d80b-4c0c-b62b-ca19f300af8e admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.345420 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361793-d0bc-4afa-8e9d-4e427d13ecbf admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.346192 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.346783 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.347062 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.347330 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.347979 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.349653 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.350730 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.351527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.351950 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.352242 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.352962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.354769 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.363664 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 580/1169] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:46:53.365724 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 590/1170] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:46:53.367862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.369576 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.377447 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a9feb-35b8-46a3-98b3-3d949df40814 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.379530 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98fb46-4b41-447b-90be-090793abb0be admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.382169 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.382813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.383091 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.383364 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] PATH_INFO: `/v3/projects/99d9bbf69c444955b24a82c13676d9dc/users/6aefe0f828c848f092aa114b6fc75f49/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.384136 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.384784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.385060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.385325 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] PATH_INFO: `/v3/projects/6c9eac4558ce47299716eb8b751105a5/users/5122809095be4347a68385a4bece3009/roles/becf529cca0348e1a6ed9bd74200b731` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.398083 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d9bbf69c444955b24a82c13676d9dc, user_id=6aefe0f828c848f092aa114b6fc75f49, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.399174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:46:53.399174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:46:53.399174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:46:53.400463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9eac4558ce47299716eb8b751105a5, user_id=5122809095be4347a68385a4bece3009, role_id=becf529cca0348e1a6ed9bd74200b731)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.401150 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b016e-fc1e-46f2-ba86-2c1c61a88abf admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.403134 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6605-bf1d-4317-872e-9ab71873b649 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.415360 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 581/1171] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:46:53 2022] PUT /identity/v3/projects/99d9bbf69c444955b24a82c13676d9dc/users/6aefe0f828c848f092aa114b6fc75f49/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:46:53.418531 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 591/1172] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:46:53 2022] PUT /identity/v3/projects/6c9eac4558ce47299716eb8b751105a5/users/5122809095be4347a68385a4bece3009/roles/becf529cca0348e1a6ed9bd74200b731 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:46:53.422127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.422127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.422127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.423388 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.423679 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.423958 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.438748 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.439944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.442100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] MFA Rules not processed for user `8b4c21c326a741f8bc5b0a71851754ff`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:53.443268 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.482196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:53.492435 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:53.501223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 582/1173] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:46:53.505590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 592/1174] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:46:53.514349 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.516260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:53.517715 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:53.567492 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5652-87ab-4f26-8b3b-fb66310802ab None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.571065 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.571671 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.571949 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.572223 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.581706 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.583155 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfb8b8-05f2-466d-978f-55e78bf47ae6 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.583485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe0cc-f565-4437-bb4c-99d14e2d354e None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:53.587176 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:53.587757 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:53.588347 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:53.588619 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:53.592834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 583/1175] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:46:53.597895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:53.599351 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:53.609366 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 593/1176] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:46:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:46:59.310319 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.310881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.310881 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.355835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:59.357913 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:59.478329 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:59.481274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 584/1177] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:59 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:46:59.500214 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadb8b-1155-4822-8863-ed84b736baf9 service neutron] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:59.516527 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:59.517182 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.517455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.517780 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] PATH_INFO: `/v3/projects` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.518449 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:59.520386 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:59.557660 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 594/1178] 10.222.0.20 () {60 vars in 1153 bytes} [Sat Aug 20 20:46:59 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:46:59.559991 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:59.580268 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86ef79-35b1-442f-95be-33a56f14093c None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:59.668353 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:59.669026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.669311 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.669588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] PATH_INFO: `/v3/users` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.670300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:59.672346 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:59.711370 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 585/1179] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:46:59 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:46:59.714704 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:59.733067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87af1-c4da-40c6-a07a-878c6fcb973b admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:59.739633 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:59.740537 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.740972 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.741455 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.742488 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:59.749878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:59.767569 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 595/1180] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:46:59.771905 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:59.800253 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d574cf-9047-4a25-b471-f919c36d7058 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:59.817043 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:59.817714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.817983 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.818281 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] PATH_INFO: `/v3/projects/ac6e08761e894b90bde807054a249126/users/ceefe99f06864c59966b6ff567021d35/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.824123 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:59.843517 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6e08761e894b90bde807054a249126, user_id=ceefe99f06864c59966b6ff567021d35, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:46:59.846661 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd93e-1b95-44ef-85c4-9dcd0983bb16 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:46:59.877760 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 586/1181] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:46:59 2022] PUT /identity/v3/projects/ac6e08761e894b90bde807054a249126/users/ceefe99f06864c59966b6ff567021d35/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:46:59.881895 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:46:59.908931 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d54c-ec92-41e6-97ef-3dd6c37b570e admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:46:59.919883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.920180 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.920461 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.962667 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] MFA Rules not processed for user `6aefe0f828c848f092aa114b6fc75f49`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:46:59.965045 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:46:59.996672 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:46:59.997301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:46:59.997577 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:46:59.998000 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] PATH_INFO: `/v3/roles` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:46:59.998675 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.000463 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.011074 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 596/1182] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:47:00.015462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.029189 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4a10a-28b5-4895-9407-80bca63e642e admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.034107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.034838 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.035072 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.035598 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] PATH_INFO: `/v3/projects/ac6e08761e894b90bde807054a249126/users/ceefe99f06864c59966b6ff567021d35/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.038329 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6e08761e894b90bde807054a249126, user_id=ceefe99f06864c59966b6ff567021d35, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.041049 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.046365 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:46:59 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 20 20:47:00.050539 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.053248 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 597/1184] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:47:00 2022] PUT /identity/v3/projects/ac6e08761e894b90bde807054a249126/users/ceefe99f06864c59966b6ff567021d35/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:47:00.061819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc6f6b-15b9-4707-9c16-88b8014f495b None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.134910 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.135546 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.135852 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.136496 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.137149 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.139998 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.174521 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 588/1185] 10.222.0.20 () {60 vars in 1153 bytes} [Sat Aug 20 20:47:00 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 20 20:47:00.179172 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.191229 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedadb1-adea-4d11-ab5d-078dac6f2ff8 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.233220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:00.264343 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.265198 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.265557 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.265930 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] PATH_INFO: `/v3/users` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.266754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.271678 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.300359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 598/1186] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Aug 20 20:47:00 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 20 20:47:00.304564 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.316114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7aae2-9295-4a54-a75e-75cff700ca66 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.326497 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.332590 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.332883 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.333160 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.339434 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.341159 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.367834 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 589/1187] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 20 20:47:00.371910 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.396754 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac75e7-b776-463d-a997-630271ffe5fb admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.404896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.405913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.406297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.406670 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] PATH_INFO: `/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4/users/237cbd36f7454a9ca5535292c50e6639/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.439444 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a578ddd15d4cadbee18c0d648c7ed4, user_id=237cbd36f7454a9ca5535292c50e6639, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.442603 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.473663 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 599/1188] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:47:00 2022] PUT /identity/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4/users/237cbd36f7454a9ca5535292c50e6639/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:47:00.477975 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.491812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df05c5-38fb-4cfa-bb55-7774b758f7c8 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.547481 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:00.570329 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.571390 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.571904 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.572355 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.573219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.575277 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8007-680c-42af-84d0-80c068cfc3e0 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.594085 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 590/1189] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Aug 20 20:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 20 20:47:00.600482 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:00.614559 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba450-6d17-49c8-bf5f-9fed0ae3f62c admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:00.630694 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:00.631374 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] REQUEST_METHOD: `PUT` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:00.631944 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:00.632396 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] PATH_INFO: `/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4/users/237cbd36f7454a9ca5535292c50e6639/roles/b8646ec5f7cb4e1e90f8388a4d681991` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:00.640705 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a578ddd15d4cadbee18c0d648c7ed4, user_id=237cbd36f7454a9ca5535292c50e6639, role_id=b8646ec5f7cb4e1e90f8388a4d681991)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:00.643935 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:00.665657 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 600/1190] 10.222.0.20 () {60 vars in 1483 bytes} [Sat Aug 20 20:47:00 2022] PUT /identity/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4/users/237cbd36f7454a9ca5535292c50e6639/roles/b8646ec5f7cb4e1e90f8388a4d681991 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:47:05.348392 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b188d-ccf9-4b4c-972d-388d20879ba5 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:05.348849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b188d-ccf9-4b4c-972d-388d20879ba5 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:05.348944 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b188d-ccf9-4b4c-972d-388d20879ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:05.395596 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-ac7b188d-ccf9-4b4c-972d-388d20879ba5 None None] MFA Rules not processed for user `ceefe99f06864c59966b6ff567021d35`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:05.396862 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-ac7b188d-ccf9-4b4c-972d-388d20879ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:05.523298 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 591/1191] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:47:05 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:05.535726 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:05.537758 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:05.676719 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ad9b-c8d2-4c80-b4ac-4187ec90855c admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:05.683332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed64374e93484949aeca834b88b14e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:05.684093 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:05.684656 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:05.684813 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:05.756338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:05.758789 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:05.775355 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 601/1192] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:05 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:06.181805 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca70f-295d-4944-8d0d-0a7f65e491a0 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:06.182357 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca70f-295d-4944-8d0d-0a7f65e491a0 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:06.182639 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca70f-295d-4944-8d0d-0a7f65e491a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:06.219678 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-c07ca70f-295d-4944-8d0d-0a7f65e491a0 None None] MFA Rules not processed for user `237cbd36f7454a9ca5535292c50e6639`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:06.221470 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-c07ca70f-295d-4944-8d0d-0a7f65e491a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:06.302586 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 592/1193] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:47:06 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:06.315153 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:06.328652 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c180c-e9a7-4504-9ddd-91248fe7e32d service glance] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:06.332485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed64374e93484949aeca834b88b14e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:06.333183 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:06.333471 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:06.333793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:06.373456 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:06.416094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:06.417768 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab815-d01b-46af-bfc0-7aa15963bce6 service glance] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:06.438342 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 602/1194] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:06 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:15.090841 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629050d-be33-445c-a58f-38ecabf77794 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.091468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629050d-be33-445c-a58f-38ecabf77794 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.091468 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629050d-be33-445c-a58f-38ecabf77794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.110780 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-2629050d-be33-445c-a58f-38ecabf77794 None None] MFA Rules not processed for user `6aefe0f828c848f092aa114b6fc75f49`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:15.112005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-2629050d-be33-445c-a58f-38ecabf77794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:15.124615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 593/1195] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:15.429454 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ec40-9385-4b0d-b1b3-9ce8fb26b43f None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.430084 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ec40-9385-4b0d-b1b3-9ce8fb26b43f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.430262 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ec40-9385-4b0d-b1b3-9ce8fb26b43f None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.431793 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 603/1196] 10.222.0.20 () {54 vars in 962 bytes} [Sat Aug 20 20:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:47:15.438437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747502b-d4b2-4cb5-afc0-47422689ef17 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.438813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747502b-d4b2-4cb5-afc0-47422689ef17 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.439190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747502b-d4b2-4cb5-afc0-47422689ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.475198 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-e747502b-d4b2-4cb5-afc0-47422689ef17 None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:15.476388 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-e747502b-d4b2-4cb5-afc0-47422689ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:15.518849 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:15.559416 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 594/1197] 10.222.0.20 () {58 vars in 1059 bytes} [Sat Aug 20 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:15.564796 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.565087 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.565364 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.566732 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 604/1198] 10.222.0.20 () {54 vars in 912 bytes} [Sat Aug 20 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:47:15.572084 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40162a0-6dd6-495a-b2be-1059a3b0082d None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.572649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40162a0-6dd6-495a-b2be-1059a3b0082d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.573095 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40162a0-6dd6-495a-b2be-1059a3b0082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.599296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a40162a0-6dd6-495a-b2be-1059a3b0082d None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:15.601437 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a40162a0-6dd6-495a-b2be-1059a3b0082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:15.611817 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 595/1199] 10.222.0.20 () {58 vars in 1009 bytes} [Sat Aug 20 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:15.624418 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:15.626289 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:15.641078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941ac5-4b5c-440a-8d6b-a3aa5af70414 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:15.645110 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed64374e93484949aeca834b88b14e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:15.645858 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:15.646234 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:15.646609 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:15.660277 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:15.662042 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b46176-1650-413d-af5b-96c33a9f64d3 service glance] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:15.681040 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 605/1200] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:16.050886 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecb27-8ee3-441d-96d0-e99d4355d026 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.051190 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecb27-8ee3-441d-96d0-e99d4355d026 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.051461 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecb27-8ee3-441d-96d0-e99d4355d026 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.052794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 596/1201] 10.222.0.20 () {54 vars in 912 bytes} [Sat Aug 20 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:47:16.058332 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a05-f53a-41a8-ab32-61a3983e0e24 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.058686 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a05-f53a-41a8-ab32-61a3983e0e24 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.059028 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a05-f53a-41a8-ab32-61a3983e0e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.084936 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e21a6a05-f53a-41a8-ab32-61a3983e0e24 None None] MFA Rules not processed for user `3624329d433947bf941772510a5423fb`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:16.086185 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e21a6a05-f53a-41a8-ab32-61a3983e0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:16.158837 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1009 bytes} [Sat Aug 20 20:47:16 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:16.170813 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adecb27-8ee3-441d-96d0-e99d4355d026 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:16.182212 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adecb27-8ee3-441d-96d0-e99d4355d026 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:16.190465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:16.191075 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.191353 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.191629 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.202129 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:16.204240 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2e894-d8f7-41c4-826e-79ef30a56708 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:16.212622 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 597/1203] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:16 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:16.653067 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65804-aaff-48aa-a45f-c9449201b4e9 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.653656 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65804-aaff-48aa-a45f-c9449201b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.653656 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65804-aaff-48aa-a45f-c9449201b4e9 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.654972 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 607/1204] 10.222.0.20 () {54 vars in 962 bytes} [Sat Aug 20 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:47:16.665605 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c78c-f342-42fc-bd26-5e8045863427 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.665909 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c78c-f342-42fc-bd26-5e8045863427 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.666181 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c78c-f342-42fc-bd26-5e8045863427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.680169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc65804-aaff-48aa-a45f-c9449201b4e9 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:16.706007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f213c78c-f342-42fc-bd26-5e8045863427 None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:16.707602 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f213c78c-f342-42fc-bd26-5e8045863427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:16.720676 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 598/1205] 10.222.0.20 () {58 vars in 1059 bytes} [Sat Aug 20 20:47:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:16.729123 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246af63-2dab-4e5a-b9d8-7f813a2d2d5d None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.729669 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246af63-2dab-4e5a-b9d8-7f813a2d2d5d None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.730097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246af63-2dab-4e5a-b9d8-7f813a2d2d5d None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.732219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 599/1206] 10.222.0.20 () {54 vars in 912 bytes} [Sat Aug 20 20:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 20 20:47:16.740047 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.740343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.740618 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.768092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:16.770453 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:16.779914 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc65804-aaff-48aa-a45f-c9449201b4e9 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:16.784020 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 600/1207] 10.222.0.20 () {58 vars in 1009 bytes} [Sat Aug 20 20:47:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:16.787541 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:16.788321 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.788674 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.789100 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.791457 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:16.797666 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:16.812324 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b9ba-bb59-4351-92d4-b5651812b21f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:16.817912 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:16.819377 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:16.820015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:16.820296 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:16.820429 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6034c-d3c4-41e5-8dc4-0b65038907ae service placement] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:16.820552 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:16.836112 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:16.837666 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:16.840210 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 608/1208] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:47:16.851156 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 601/1209] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:47:26.829326 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=74 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:26.845215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=33 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:30.778468 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c9f8-1e16-46b5-9740-1ffca5422d0d None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:30.779046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c9f8-1e16-46b5-9740-1ffca5422d0d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:30.779046 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c9f8-1e16-46b5-9740-1ffca5422d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:30.807637 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-9c39c9f8-1e16-46b5-9740-1ffca5422d0d None None] MFA Rules not processed for user `3624329d433947bf941772510a5423fb`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:30.808867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-9c39c9f8-1e16-46b5-9740-1ffca5422d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:30.815820 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 609/1210] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 20 20:47:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:30.828322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:30.839224 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a1607-329b-4dd4-bb15-5f2ab1f3a81e service neutron] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:30.844747 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:30.845339 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:30.845647 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:30.845907 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:30.853740 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:30.855274 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97c431-3968-4578-86d8-58ea1b012bfe service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:30.863901 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 602/1211] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:30 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:31.616929 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ac03-377f-4637-b238-c2be07004e89 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:31.617199 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ac03-377f-4637-b238-c2be07004e89 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:31.617477 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ac03-377f-4637-b238-c2be07004e89 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:31.618867 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 610/1212] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:47:31.664808 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72839-811b-4692-9c7e-02707184def4 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:31.665171 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72839-811b-4692-9c7e-02707184def4 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:31.665363 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72839-811b-4692-9c7e-02707184def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:31.688314 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-4cd72839-811b-4692-9c7e-02707184def4 None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:31.689563 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-4cd72839-811b-4692-9c7e-02707184def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:31.699344 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 603/1213] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:47:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:31.840143 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ac03-377f-4637-b238-c2be07004e89 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:31.856337 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ac03-377f-4637-b238-c2be07004e89 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:31.861521 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:31.862174 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:31.862451 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:31.862740 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:31.872108 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:31.873756 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb602-300f-4359-89cd-d9962ff70d34 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:31.886874 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 611/1214] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:47:39.037383 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5c8-1787-432f-bce7-fb561fc0301e None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:39.038077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5c8-1787-432f-bce7-fb561fc0301e None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:39.038077 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5c8-1787-432f-bce7-fb561fc0301e None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:39.039360 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 604/1215] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:47:39.051558 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c594-f164-454f-909a-fcfd6951879f None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:39.052405 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c594-f164-454f-909a-fcfd6951879f None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:39.053006 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c594-f164-454f-909a-fcfd6951879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:39.079851 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-6627c594-f164-454f-909a-fcfd6951879f None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:47:39.082058 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-6627c594-f164-454f-909a-fcfd6951879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:47:39.094341 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 612/1216] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:47:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:47:39.111951 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc5c8-1787-432f-bce7-fb561fc0301e None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:39.125717 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc5c8-1787-432f-bce7-fb561fc0301e None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:39.130673 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:39.131287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:39.131615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:39.131921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:39.140734 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:39.142362 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb43d-2f0e-414b-8695-d574945a4efd service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:39.154960 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 605/1217] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:47:49.073520 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=12 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:49.148679 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=15 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:50.960092 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627c594-f164-454f-909a-fcfd6951879f None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:47:50.969839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627c594-f164-454f-909a-fcfd6951879f None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:47:50.973839 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:47:50.974590 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:47:50.974932 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:47:50.975278 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:47:50.985364 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:47:50.986994 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338326c-bc1a-4ee8-83da-afbc37978e95 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:47:50.998568 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 613/1218] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:47:50 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:48:00.993197 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=6 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:05.518636 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:05.519174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:05.519174 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:05.539409 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:48:05.540634 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:48:05.548865 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 606/1219] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:48:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:48:05.879363 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ae5-7078-423b-a0e8-edbb33529927 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:05.879893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ae5-7078-423b-a0e8-edbb33529927 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:05.879893 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ae5-7078-423b-a0e8-edbb33529927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:05.902169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-c7437ae5-7078-423b-a0e8-edbb33529927 None None] MFA Rules not processed for user `3624329d433947bf941772510a5423fb`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:48:05.903361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-c7437ae5-7078-423b-a0e8-edbb33529927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:48:05.910945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 614/1220] 10.222.0.20 () {58 vars in 1009 bytes} [Sat Aug 20 20:48:05 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:48:05.922912 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:48:05.932681 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaf35-9691-4077-a1b9-0305c9878815 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:48:05.936179 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:48:05.936775 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:05.937019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:05.937314 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:05.944219 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:48:05.945658 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425267-bd9e-4248-a46f-dc2de9cdf8b8 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:48:05.953716 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 607/1221] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:48:05 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:48:15.896491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:15.950133 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=9 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:25.101696 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463f23c-c049-4d7c-85f7-96aeb39373a0 None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:25.102164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463f23c-c049-4d7c-85f7-96aeb39373a0 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:25.102255 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463f23c-c049-4d7c-85f7-96aeb39373a0 None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:25.103596 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 615/1222] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:48:25.109705 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c234b80-cb9a-4959-935d-131dc7edfd01 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:25.110164 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c234b80-cb9a-4959-935d-131dc7edfd01 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:25.110259 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c234b80-cb9a-4959-935d-131dc7edfd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:25.131087 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-0c234b80-cb9a-4959-935d-131dc7edfd01 None None] MFA Rules not processed for user `551583a3f32e433cae6bbbd33e862ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:48:25.132525 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-0c234b80-cb9a-4959-935d-131dc7edfd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:48:25.141114 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 608/1223] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:48:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:48:25.153138 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463f23c-c049-4d7c-85f7-96aeb39373a0 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:48:25.166421 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463f23c-c049-4d7c-85f7-96aeb39373a0 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:48:25.171346 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:48:25.171949 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:25.172226 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:25.172498 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:25.180801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:48:25.182445 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5cf46-3e0f-46f4-924d-9f5cfea2ceac service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:48:25.191945 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 616/1224] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:48:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:48:31.099208 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2e6c-232b-4d56-af75-80c427e539e7 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:31.099993 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2e6c-232b-4d56-af75-80c427e539e7 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:31.100092 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce2e6c-232b-4d56-af75-80c427e539e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:31.126204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-01ce2e6c-232b-4d56-af75-80c427e539e7 None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:48:31.127502 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-01ce2e6c-232b-4d56-af75-80c427e539e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:48:31.135800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 609/1225] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:48:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:48:35.188362 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=6 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:41.120781 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=6 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:45.796519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:48:45.796998 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:48:45.797107 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:48:45.817237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:48:45.818481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:48:45.826487 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 617/1226] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:48:45 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:48:55.811848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:49:45.602005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:49:45.602903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:49:45.602903 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:49:45.623127 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:49:45.624332 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:49:45.631648 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 610/1227] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:49:45 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:49:55.617809 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=3 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:49:58.617515 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:49:58.638239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aca9f-a172-4bad-abed-54d0972990b2 None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:49:58.642305 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:49:58.642917 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:49:58.643192 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:49:58.643466 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:49:58.653392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:49:58.654896 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:49:58.664465 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 618/1228] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:49:58 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:50:08.660170 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=10 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:50:23.011606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:50:23.028673 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6821e8b-9e56-45ce-bc67-d1229b3121a1 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:50:23.034297 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:50:23.034938 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:50:23.035248 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:50:23.035516 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:50:23.045804 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:50:23.047615 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2652-f7be-4f6c-b963-3f5328c2fcd0 service placement] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:50:23.061128 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 611/1229] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:50:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:50:33.055118 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=6 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:05.257499 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:05.285493 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fddf4-0aa5-4b6d-a6a8-db915502d46e service neutron] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:05.291352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:05.291981 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:05.292260 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:05.292533 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:05.300710 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:05.302377 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:05.311962 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 619/1230] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:05 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:08.959015 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:08.959536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:08.959536 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:08.979794 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:52:08.981131 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:52:08.988697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 612/1231] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:52:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:52:15.307566 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=10 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:16.915564 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:16.925664 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bac59e-d31e-48b1-b102-5eaf5c4e3c68 service nova] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:16.929755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:16.930404 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:16.930680 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:16.930954 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:16.941215 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:16.942900 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:16.953536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 620/1232] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:18.156943 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:18.170201 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14749611-e830-468b-8ca2-26c26ec8b208 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:18.174475 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:18.175100 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:18.175380 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:18.175649 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:18.186322 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:18.187812 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a323ac-addb-453c-bd39-6b3d54eada87 service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:18.198354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 613/1233] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:19.635301 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:19.646320 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b551d9e-fa17-4b0a-ac60-bd111b0a9704 service neutron] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:19.652676 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:19.653314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:19.653581 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:19.653882 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:19.662438 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:19.664083 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:19.672913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 621/1234] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:19 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:28.193500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=9 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:29.669024 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=12 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:35.239243 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119197-fdb0-4b63-9d66-b5bc5168d6c8 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:35.239762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119197-fdb0-4b63-9d66-b5bc5168d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:35.239854 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119197-fdb0-4b63-9d66-b5bc5168d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:35.260352 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-26119197-fdb0-4b63-9d66-b5bc5168d6c8 None None] MFA Rules not processed for user `6aefe0f828c848f092aa114b6fc75f49`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:52:35.261581 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-26119197-fdb0-4b63-9d66-b5bc5168d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:52:35.269244 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 614/1235] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:52:35.538322 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:35.548513 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd180a4-62af-4745-aa6e-7484e1a92502 service nova] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:35.552621 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:35.553270 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:35.553551 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:35.553854 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:35.560918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:35.562397 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def9b29-c21f-4e99-af24-158720947cab service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:35.570207 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 622/1236] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:35 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:35.899800 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecfbf-fb2c-4d14-8fd3-1a22a75f400f None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:35.900237 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecfbf-fb2c-4d14-8fd3-1a22a75f400f None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:35.900585 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecfbf-fb2c-4d14-8fd3-1a22a75f400f None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:35.902041 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 615/1237] 10.222.0.20 () {54 vars in 961 bytes} [Sat Aug 20 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:52:35.907244 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:35.907536 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:35.907808 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:35.975755 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:52:35.976964 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:52:35.996403 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 623/1238] 10.222.0.20 () {58 vars in 1058 bytes} [Sat Aug 20 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:52:36.007674 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ecfbf-fb2c-4d14-8fd3-1a22a75f400f None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:36.022439 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ecfbf-fb2c-4d14-8fd3-1a22a75f400f None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:36.028725 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:36.029335 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:36.029637 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:36.029915 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:36.038594 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:36.040202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:36.049954 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 616/1239] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:36 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:45.991671 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=28 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:46.046005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=9 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:47.735164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:47.746428 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ae8fa-3e1a-45e9-98d0-a25a1c1e8d3d None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:47.750967 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:47.751664 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:47.751977 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:47.752294 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:47.766352 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:47.767991 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:47.776599 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 624/1240] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 20 20:52:54.501500 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:52:54.513647 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcc44-2326-4594-842e-e8f6a7632a11 service placement] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:52:54.519142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:52:54.519756 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:52:54.520031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:52:54.520300 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:52:54.528869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:52:54.530486 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:52:54.540267 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 617/1241] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:52:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:52:57.772865 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=6 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:53:03.085643 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:53:03.094105 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ad13d-b82c-40c6-a09c-54ff594c90c0 service neutron] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:53:03.098481 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:53:03.099079 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:53:03.099359 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:53:03.099624 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:53:03.108801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:53:03.110291 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c627-a2fd-410d-b67f-1d246739d421 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:53:03.121229 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 625/1242] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:53:03 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:53:04.536147 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=6 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:53:04.848142 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:53:04.859215 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8a2-9bac-4ae4-bf37-e5f83d3a0b8b service nova] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:53:04.865366 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:53:04.866030 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:53:04.866325 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:53:04.866598 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:53:04.875795 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:53:04.877843 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:53:04.888058 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 618/1243] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:53:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:53:13.116267 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=6 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:53:14.883691 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=6 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:54:14.666290 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:54:14.666848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:54:14.666848 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:54:14.688111 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] MFA Rules not processed for user `5122809095be4347a68385a4bece3009`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:54:14.689299 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:54:14.697959 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 626/1244] 10.222.0.20 () {58 vars in 958 bytes} [Sat Aug 20 20:54:14 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:54:15.012722 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:54:15.022046 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc7e9-32ab-4278-aa76-d7bd4a05480d service nova] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:54:15.025921 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:54:15.026515 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:54:15.026791 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:54:15.027060 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:54:15.034170 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:54:15.035590 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:54:15.043819 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 619/1245] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:54:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:54:17.922866 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:54:17.947281 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44a6d-a554-409a-9b04-a7a0ef2d40ea None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:54:17.955894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551583a3f32e433cae6bbbd33e862ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:54:17.956842 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:54:17.957120 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:54:17.957392 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:54:17.968826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:54:17.970507 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:54:17.981589 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 627/1246] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:54:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:54:25.040233 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=6 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:54:27.977154 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=9 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:28.842483 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:28.886287 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739c10-8cfb-4723-822e-6aeab3057c8c service neutron] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:28.891869 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:28.892485 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:28.892762 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:28.893033 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:28.894989 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:55:28.925097 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:28.926721 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ea33-53d2-4a41-b47e-ba31679c10a9 service placement] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:28.936276 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 620/1247] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:55:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:55:31.954635 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:31.977060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879af55-13c3-4ef2-9fbf-ee46328fb682 service nova] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:31.980826 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:31.981469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:31.981745 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:31.982020 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:32.055803 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:32.057452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d78664-ca25-47dc-a992-873003324684 service neutron] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:32.078612 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 628/1248] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:55:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:55:35.397397 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3f909-631a-48d1-b1d0-9024ca64a2b9 None None] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:35.398005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3f909-631a-48d1-b1d0-9024ca64a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:35.398005 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3f909-631a-48d1-b1d0-9024ca64a2b9 None None] PATH_INFO: `/` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:35.399305 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 621/1249] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:55:35.410827 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71217e8-c775-4d60-817d-806034121e5e None None] REQUEST_METHOD: `POST` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:35.411297 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71217e8-c775-4d60-817d-806034121e5e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:35.411491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71217e8-c775-4d60-817d-806034121e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:35.443239 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.auth.core [None req-e71217e8-c775-4d60-817d-806034121e5e None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:55:35.444461 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-e71217e8-c775-4d60-817d-806034121e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:55:35.453335 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 629/1250] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:55:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:55:35.477569 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3f909-631a-48d1-b1d0-9024ca64a2b9 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:35.495587 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3f909-631a-48d1-b1d0-9024ca64a2b9 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:35.501049 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:35.501606 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:35.501916 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:35.502183 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:35.511588 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:35.513201 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e573f4-3fa7-40a1-8844-aa52ec59367b service placement] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:35.524050 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 622/1251] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:55:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:55:38.887516 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57738-6ebb-4f2c-8a09-a73a2f32e35e None None] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:38.888027 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57738-6ebb-4f2c-8a09-a73a2f32e35e None None] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:38.888173 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57738-6ebb-4f2c-8a09-a73a2f32e35e None None] PATH_INFO: `/` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:38.889833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 630/1252] 10.222.0.20 () {54 vars in 921 bytes} [Sat Aug 20 20:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 20 20:55:38.900206 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] REQUEST_METHOD: `POST` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:38.901204 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:38.901544 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:38.924103 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.auth.core [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] MFA Rules not processed for user `ed027c48f80c43ed82731961fa46e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=94924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 20 20:55:38.925560 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:55:38.935465 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 623/1253] 10.222.0.20 () {58 vars in 1018 bytes} [Sat Aug 20 20:55:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 20 20:55:38.954062 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57738-6ebb-4f2c-8a09-a73a2f32e35e None None] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:38.968920 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57738-6ebb-4f2c-8a09-a73a2f32e35e None None] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:38.973532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:38.974787 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:38.975510 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:38.976002 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:38.976489 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:38.986522 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:38.986652 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454756-8d74-4117-9d70-03a63004fe79 None None] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:38.988142 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:38.995889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:38.995889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:38.995889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:38.995889 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] PATH_INFO: `/v3/users/6aefe0f828c848f092aa114b6fc75f49` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:38.996278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aefe0f828c848f092aa114b6fc75f49)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:38.996278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: WARNING py.warnings [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:55:38.996278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: warnings.warn(msg) Aug 20 20:55:38.996278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: Aug 20 20:55:38.996278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:38.998801 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 631/1254] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:55:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:55:39.060278 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aefe0f828c848f092aa114b6fc75f49'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.078031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aefe0f828c848f092aa114b6fc75f49'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.078714 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aefe0f828c848f092aa114b6fc75f49'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.079343 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aefe0f828c848f092aa114b6fc75f49'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.090161 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aefe0f828c848f092aa114b6fc75f49'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.104873 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 624/1255] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Aug 20 20:55:38 2022] DELETE /identity/v3/users/6aefe0f828c848f092aa114b6fc75f49 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:55:39.286563 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:39.298669 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c27c9-f30a-43fc-aa40-7cbc9b039e58 service placement] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:39.357361 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:39.358078 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:39.358353 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:39.358620 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] PATH_INFO: `/v3/projects/99d9bbf69c444955b24a82c13676d9dc` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:39.359821 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d9bbf69c444955b24a82c13676d9dc)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:39.360868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: WARNING py.warnings [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 20 20:55:39.360868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: warnings.warn(msg) Aug 20 20:55:39.360868 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: Aug 20 20:55:39.362265 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:39.405866 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:39.418237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d9bbf69c444955b24a82c13676d9dc', 'request_id': 'req-b949e275-5fa1-4aab-aac4-51701ab7373b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.424338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d9bbf69c444955b24a82c13676d9dc', 'request_id': 'req-b949e275-5fa1-4aab-aac4-51701ab7373b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.437784 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d9bbf69c444955b24a82c13676d9dc', 'request_id': 'req-b949e275-5fa1-4aab-aac4-51701ab7373b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.465452 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] The token cache is being invalidate because project 99d9bbf69c444955b24a82c13676d9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 20 20:55:39.465790 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.466491 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.468148 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 632/1256] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Aug 20 20:55:39 2022] DELETE /identity/v3/projects/99d9bbf69c444955b24a82c13676d9dc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:55:39.472279 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:39.473821 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:55:39.487713 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61977895-6d2f-4a25-9222-9f1fd1fda934 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:39.536532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:39.549026 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:39.549879 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:39.550361 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:39.550641 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] PATH_INFO: `/v3/users/237cbd36f7454a9ca5535292c50e6639` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:39.551792 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237cbd36f7454a9ca5535292c50e6639)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:39.553830 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:39.603019 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237cbd36f7454a9ca5535292c50e6639'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.616365 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237cbd36f7454a9ca5535292c50e6639'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.617031 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237cbd36f7454a9ca5535292c50e6639'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.617670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237cbd36f7454a9ca5535292c50e6639'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.624703 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237cbd36f7454a9ca5535292c50e6639'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.639178 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 625/1257] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Aug 20 20:55:39 2022] DELETE /identity/v3/users/237cbd36f7454a9ca5535292c50e6639 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:55:39.826106 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:55:39.827725 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:55:39.841863 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e275-5fa1-4aab-aac4-51701ab7373b admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:55:39.903547 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:55:39.904204 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:55:39.904519 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:55:39.904833 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] PATH_INFO: `/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:55:39.905998 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a578ddd15d4cadbee18c0d648c7ed4)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:55:39.907913 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:55:39.955220 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a578ddd15d4cadbee18c0d648c7ed4', 'request_id': 'req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.961485 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a578ddd15d4cadbee18c0d648c7ed4', 'request_id': 'req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.967832 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a578ddd15d4cadbee18c0d648c7ed4', 'request_id': 'req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.981263 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] The token cache is being invalidate because project 27a578ddd15d4cadbee18c0d648c7ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 20 20:55:39.981553 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.982240 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:55:39.983789 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 633/1258] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Aug 20 20:55:39 2022] DELETE /identity/v3/projects/27a578ddd15d4cadbee18c0d648c7ed4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:55:49.635898 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:49.978545 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=66,keystone:DELETE=11,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:56:52.693697 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:56:52.695134 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:56:52.751734 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3ec49-12d3-4854-8533-8175728801b2 admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:56:52.799295 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3624329d433947bf941772510a5423fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:56:52.799830 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] REQUEST_METHOD: `GET` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:56:52.800107 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:56:52.800379 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:56:52.802221 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:56:52.864231 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:56:52.865744 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:56:52.875275 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 626/1259] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 20:56:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 20:56:59.188649 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:56:59.190210 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:56:59.203338 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381c3a8-aade-4bfc-a124-620fc3aa9a0b admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:56:59.208235 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:56:59.208880 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:56:59.209162 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:56:59.209441 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] PATH_INFO: `/v3/users/5122809095be4347a68385a4bece3009` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:56:59.223152 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5122809095be4347a68385a4bece3009)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:56:59.225060 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:56:59.273237 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5122809095be4347a68385a4bece3009'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.273968 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5122809095be4347a68385a4bece3009'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.282164 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5122809095be4347a68385a4bece3009'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.282840 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5122809095be4347a68385a4bece3009'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.291266 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5122809095be4347a68385a4bece3009'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.310432 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 634/1260] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Aug 20 20:56:59 2022] DELETE /identity/v3/users/5122809095be4347a68385a4bece3009 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:56:59.505108 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:56:59.515427 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807163a3-db19-4525-9d81-d101bcade18d service neutron] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:56:59.574059 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:56:59.574682 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:56:59.574965 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:56:59.575238 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] PATH_INFO: `/v3/projects/6c9eac4558ce47299716eb8b751105a5` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:56:59.584038 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=100 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:56:59.586777 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9eac4558ce47299716eb8b751105a5)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:56:59.589007 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:56:59.640184 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9eac4558ce47299716eb8b751105a5', 'request_id': 'req-4590db2d-9d07-4529-a545-98287e1a079a'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.648202 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9eac4558ce47299716eb8b751105a5', 'request_id': 'req-4590db2d-9d07-4529-a545-98287e1a079a'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.655532 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9eac4558ce47299716eb8b751105a5', 'request_id': 'req-4590db2d-9d07-4529-a545-98287e1a079a'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.666850 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] The token cache is being invalidate because project 6c9eac4558ce47299716eb8b751105a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 20 20:56:59.667176 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.667835 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.669374 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 627/1261] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Aug 20 20:56:59 2022] DELETE /identity/v3/projects/6c9eac4558ce47299716eb8b751105a5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 20 20:56:59.673497 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:56:59.675098 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:56:59.688287 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b072-0fc2-4506-abb0-06cc23d45197 admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:56:59.746906 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:56:59.747462 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:56:59.747743 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:56:59.748017 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] PATH_INFO: `/v3/users/ceefe99f06864c59966b6ff567021d35` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:56:59.749259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceefe99f06864c59966b6ff567021d35)` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:56:59.751259 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:56:59.801247 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceefe99f06864c59966b6ff567021d35'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.801878 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceefe99f06864c59966b6ff567021d35'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.810314 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceefe99f06864c59966b6ff567021d35'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.811038 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceefe99f06864c59966b6ff567021d35'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.818571 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.notifications [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceefe99f06864c59966b6ff567021d35'} {{(pid=94925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:56:59.819673 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:56:59.842166 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 635/1262] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Aug 20 20:56:59 2022] DELETE /identity/v3/users/ceefe99f06864c59966b6ff567021d35 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:57:00.015991 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Authenticating user token {{(pid=94924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 20:57:00.017695 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.fernet_utils [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 20:57:00.033593 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590db2d-9d07-4529-a545-98287e1a079a admin admin] Validating token access rules against request {{(pid=94924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 20:57:00.091743 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b4c21c326a741f8bc5b0a71851754ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caafa8b40709435db0e905664e3dcd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 20:57:00.092386 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 20:57:00.092670 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] SCRIPT_NAME: `/identity` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 20:57:00.092947 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] PATH_INFO: `/v3/projects/ac6e08761e894b90bde807054a249126` {{(pid=94924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 20:57:00.104286 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6e08761e894b90bde807054a249126)` {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 20:57:00.106299 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] RBAC: Authorization granted {{(pid=94924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 20:57:00.157153 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6e08761e894b90bde807054a249126', 'request_id': 'req-c01244fe-b0d5-4a92-bfab-205bd3cb902e'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:57:00.165456 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6e08761e894b90bde807054a249126', 'request_id': 'req-c01244fe-b0d5-4a92-bfab-205bd3cb902e'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:57:00.172196 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6e08761e894b90bde807054a249126', 'request_id': 'req-c01244fe-b0d5-4a92-bfab-205bd3cb902e'} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:57:00.182385 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] The token cache is being invalidate because project ac6e08761e894b90bde807054a249126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 20 20:57:00.182709 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:57:00.183354 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG keystone.notifications [None req-c01244fe-b0d5-4a92-bfab-205bd3cb902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 20 20:57:00.184839 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: [pid: 94924|app: 0|req: 628/1263] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Aug 20 20:57:00 2022] DELETE /identity/v3/projects/ac6e08761e894b90bde807054a249126 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 20 20:57:09.838502 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:57:10.179706 dv-osbrick-master-4-ceph devstack@keystone.service[94924]: DEBUG dbcounter [-] [94924] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=94924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:00:36.041918 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Authenticating user token {{(pid=94925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 20 21:00:36.044171 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 21:00:36.125598 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a1c1-0a1e-468c-80f7-10b3c737f39a admin admin] Validating token access rules against request {{(pid=94925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 20 21:00:36.186995 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed027c48f80c43ed82731961fa46e5e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd05fa966421e428ead408fd7843ee67a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 20 21:00:36.187616 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] REQUEST_METHOD: `GET` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 20 21:00:36.187894 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] SCRIPT_NAME: `/identity` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 20 21:00:36.188169 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 20 21:00:36.190094 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.fernet_utils [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 20 21:00:36.201378 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 20 21:00:36.203324 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355511c-596c-44dd-bdfc-c8209cd93ade service placement] RBAC: Authorization granted {{(pid=94925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 20 21:00:36.216888 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: [pid: 94925|app: 0|req: 636/1264] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Aug 20 21:00:36 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 20 21:00:46.210469 dv-osbrick-master-4-ceph devstack@keystone.service[94925]: DEBUG dbcounter [-] [94925] Writing DB stats keystone:SELECT=58 {{(pid=94925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}